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Abstract  of  Dissertation  Presented  to  the  Graduate  School 
of  the  University  of  Florida  in  Partial  Fulfillment  of  the 
Requirements  for  the  Degree  of  Doctor  of  Philosophy 

INFERENCE  FOR  TWO-PARAMETER  EXPONENTIALS  UNDER  TYPE  I CENSORING 

By 

LILY  LLORENS  MANTELLE 
December  1986 

Chairman:  Dr.  Malay  Ghosh 

Major  Department:  Statistics 

This  investigation  considers  estimation  and  hypothesis 
testing  involving  parameters  of  one  or  more  location  and  scale 
parameter  exponentials  under  Type  I censoring  when  sampling  is 
done  both  with  and  without  replacement. 

For  sampling  with  replacement,  the  class  of  unbiasedly 
estimable  parametric  functions  is  completely  characterized.  It 
turns  out,  as  a consequence  of  our  general  results  that  quite 
often  neither  the  location  nor  the  scale  parameter  is  unbiasedly 
estimable.  The  failure  rate  admits  an  unbiased  estimator  in  some 
special  cases.  Maximum  likelihood  estimators  (MLEs)  of  the 
location  parameters  and  failure  rates  are  also  obtained.  Then  for 
the  location  parameters  a modified  MLE  is  proposed  which  achieves 
asymptotically  a 50%  mean  square  error  reduction  and  a 100%  bias 
reduction  over  the  usual  MLEs.  Asymptotic  normality  as  well  as 


-v- 


mean  square  convergence  results  are  established  for  the  MLEs  of 
the  scale  parameters. 

A parallel  investigation  is  conducted  for  the  without 
replacement  case  and  similar  results  are  obtained.  However,  in 
this  case,  only  a partial  characterization  of  estimable  parametric 
functions  is  obtained,  and  it  is  shown  also  that  neither  the 
location  nor  the  scale  parameter  admits  an  unbiased  estimator. 

Generalized  Likelihood  Ratio  Tests  (GLRT)  for  the  equality  of 
the  location  and/or  failure  rates  of  several  independent  location 
and  scale  parameters  exponentials  are  also  considered,  when 
sampling  is  done  both  with  and  without  replacement.  For  testing 
the  equality  of  the  failure  rates,  asymptotic  distributions  of  the 
GLRT  criteria  are  obtained  both  under  the  null  hypothesis  and 
under  local  alternatives.  For  testing  the  equality  of  the 
location  parameters,  asymptotic  null  distributions  of  the  GLRT 
criteria  are  obtained. 
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CHAPTER  ONE 


INTRODUCTION 

1.1  Background  and  Previous  Research 

This  investigation  considers  estimation  and  hypothesis 
testing  involving  parameters  of  one  or  more  location  and  scale 
parameters  exponentials  under  Type  I censoring.  Under  such 
censoring,  an  experiment  consisting  of  putting  units  to  test 
independently  until  they  fail  is  stopped  after  a fixed  amount  of 
time.  This  is  in  contrast  with  Type  II  censoring  where  experimen- 
tation stops  after  a fixed  number,  say  r of  failures. 

The  above  censoring  schemes  are  most  suitable  for  drawing 
inferences  based  on  lifetime  data.  Such  data  are  most  commonly 
encountered  in  engineering  and  medical  sciences.  With  the  usual 
life  testing  terminology,  the  events  of  interest  are  usually 
referred  to  as  failures,  and  the  mean  rate  of  failure  is  referred 
to  as  the  failure  rate. 

The  location-scale  exponential  distribution  is  very  often 
used  to  model  the  lifetimes  of  manufactured  items.  Such  a 
distribution  has  pdf 

f ( x ) = Z exp[-£(x-n)]I^x>Tij,  (1.1.1) 

where  p e (0,°°)  is  the  location  parameter,  and  £ e (0,°°)  is  the 
scale  parameter  and  1^=1  when  A happens  and  is  zero  otherwise. 
The  reciprocal  £ * is  called  the  scale  parameter  and  shall  be 
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denoted  by  0.  It  is  either  suspected  or  known  that  there  is  a 
"failure  free"  period  before  the  first  failure  is  observed,  and 
this  justifies  the  inclusion  of  the  location  parameter  p.  The 
parameter  space  (0,°°)  for  n is  justified  on  the  ground  that  the 
starting  time  of  an  experiment  is  conventionally  taken  as  zero. 
However,  no  technical  difficulty  is  encountered  if  one  considers 
instead  the  parameter  space  (-<*>,»)  for  p.  In  the  life-testing 
terminology,  p is  also  referred  to  as  the  guarantee  time  or  the 
threshhold  parameter.  If  t (>0)  denotes  the  censoring  time  or 
fixed  duration  of  the  experiment , it  is  assumed  that  p < t since 
otherwise  no  failures  will  occur. 

Most  of  the  inference  problems  concerning  p and  are 
usually  directed  towards  either  complete  (uncensored)  data  or  Type 
II  censored  data.  In  such  situations,  detailed  discussion  for 
estimation,  hypothesis  testing  or  confidence  intervals  in  the  one 
sample  case  appears  in  Mann,  Schafer  and  Singpurwalla  (1974). 
However,  for  Type  I censored  data,  literature  is  not  at  all  that 
extensive.  The  hypothesis  testing  problem  for  p is  addressed  in 
Wright,  Engelhardt  and  Bain  (1978)  for  the  one  sample  case  (see 
also  Bain  (1978)). 

Before  proceeding  further,  it  is  important  to  distinguish 
between  two  modes  of  sampling,  namely  sampling  with  and  without 
replacement.  In  the  former  case,  an  item  failing  before  termina- 
tion of  the  experiment,  is  either  repaired  or  replaced  by  a 
similar  new  item.  This  does  not  happen  in  the  other  case. 
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For  an  example  of  Type  I censoring  with  replacement,  consider 
the  result  of  a fatigue  test  as  conducted  by  Butler  and  Rees 
(1974)  to  determine  the  suitability  of  various  metals  for  aircraft 
construction.  In  one  phase  of  study,  titanium  and  steel  specimens 
were  tested  for  crack  initiation  due  to  fatigue.  Each  specimen  was 
subjected  to  stresses  in  varying  amounts  and  patterns  similar  to 
those  occurring  in  flight.  These  stress  patterns  were  repeated 
until  a crack  was  detected  and  the  total  number  of  load  cycles 
(which  can  be  thought  of  as  a laboratory  measure  of  flight  time) 
until  crack  detection  was  recorded.  Then  the  crack  was  repaired, 
and  the  test  was  resumed  until  another  crack  was  detected,  the 
total  number  of  load  cycles  to  this  failure  was  recorded  etc. , 
Also,  the  chi-squared  goodness-of-f it  test  indicated  for  their 
data  that  the  exponential  distribution  provided  a reasonable  model 
for  the  interfailure  times  (i.e.  the  times  between  failures)  in 
the  range  that  the  tests  were  conducted. 

For  testing  without  replacement,  the  following  example  was 
given  in  Wilk,  Gnanadesikan  and  Huyett  (1962)  and  Wright  et  al. 
(1978).  Consider  the  failure  times  (in  weeks)  from  an  accelerated 
life  test  of  several  transistors.  The  censoring  time  (measured  in 
weeks)  was  40.  Since  the  failed  transistors  were  not  replaced, 
this  was  an  example  of  sampling  without  replacement.  Engelhardt 
and  Bain  (1975)  showed  that  the  exponential  model  was  reasonable 


for  these  data. 
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For  Type  I censoring,  first  consider  the  with  replacement 
case.  Suppose  n items  are  put  to  test,  and  the  lifetimes  of  these 
items  are  iid  with  common  pdf  given  in  (1.1.1).  It  is  assumed 
that  the  lifetimes  of  repaired  or  a replacement  item  is  exponen- 
tial with  the  same  failure  rate  £,  but  with  location  para— meter 
equal  to  zero.  This  assumption  is  appropriate  in  many  instances 
because  a repaired  item  would  not  be  expected  to  have  a failure 
free  period  again.  Even  if  defective  parts  were  replaced,  such  an 
assumption  might  be  reasonable  if  the  original  parts  or  system 
were  sealed  or  treated  in  a special  manner.  Also,  lifetimes  of 
original  and  replacement  parts  are  assumed  to  be  independent. 

To  derive  the  joint  distribution  of  the  ordered  failure 

times,  one  proceeds  as  follows.  Let  denote  the  elapsed  time 
ttl 

for  the  jL1  unit  between  (i-l)st  and  ith  failure.  Note  that  by 
the  memoryless  property  of  the  exponential  pdf  we  don't  need  to 
consider  how  long  a unit  has  lived  when  constructing  these  inter- 
vals. Hence  Y^,...,Yjn  are  iid  with  pdf  given  in  (1.1.1),  while 
the  remaining  Y„ 's  are  iid  with  location  parameter  p = 0 and 

failure  rate  4.  Now  if  Y±  = min  Y±,  (i-1,2,...),  then  Y. 's 

l<j<n  J 1 

are  the  interfailure  times  of  the  experiment  and  they  are  indepen- 


dent with  pdf  of  Yj  given  as 

f(yx)  = (n?)  exp  (-n^y^n))  If  >n], 
while  Y2’^3’***  are  iid  with  common  pdf 

[y>o ] * 


(1.1.2) 


f(y)  = (n£)  exp  (-n£y) I 


(1.1.3) 
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The  ideas  previously  described  are  further  clarified  in 
Figure  1.1  for  n = 5,  i = 2 and  assuming  four  failures  occurred. 
Also,  in  Figure  1.1  we  use  X to  denote  a failed  unit  which  is 
instaneously  repaired  or  replaced  by  a similar  item  and  we  let 
denote  the  four  ordered  failure  times. 


X(l)  x(  2 ) x(3)  x(4) 


FIGURE  1.1:  Clarification  of  Interfailure  Times. 

(Note  above  that  Y„  = min  X„  ). 

2 Kj<4  2] 

The  number  of  failures  in  the  interval  (n,t)  is  a random 
variable  which  we  denote  by  R.  The  first  lemma  of  this  section 


gives  the  distribution  of  R. 
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Lemma  1.1.1  Suppose  Y^,  Y2,...  are  independent  with  pdf's  given 
in  (1.1.2)  and  (1.1.3).  Then  R ~ Poisson  (n^(t-p)). 

Proof  The  result  follows  from  the  definition  of  a Poisson  pro- 
cess (see  for  example  Barlow  and  Proschan  (1981)). 

The  next  lemma  provides  the  conditional  pdf  of  the  ordered 
failure  times  given  R = r(>0) 

Lemma  1.1.2  Given  R = r > 0,  let  1 ^ < ...  < X, ^denote  the 
ordered  failure  times.  Then  the  joint  conditional  pdf  of 
x(  1)  , . . . >x(r)  given  R = r > 0 _is_ 

f (X(  j ) > • • *x(r)  | r)  = r!(t-  n)-r,  n < x^  < ...<  x^  < t (1.1.4) 
which  is  the  joint  distribution  of  the  order  statistic  in  a random 
sample  of  size  r from  the  uniform  (p,t)  distribution. 

Proof  Note  that  given  R = r > 0 


Hence,  using  the  fact  that  P(Yi  > y)  = exp(-n?y)  for  i > 2 
f(x(l)>* •• >x(r) | r) 


r 


(i) 


= [ (n£)r  exp(-n?(t-p))]/[exp(-nc(t-n))(nc(t-n)}r]/r! 


= r!  (t-n)  r.  □ 


In  view  of  Lemmas  1.1.1  and  1.1.2,  the  joint  pdf  of 
X^  1 ^ , . . . jX^j-q  and  R is  given  by 


f(x(1),...,X(r),r)  = (n?)rexp(-n?(t-ri)) , n<x^<. 
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r = 1,2,...  (1.1.5) 

P(R  = 0)  = exp  (-n?(t  - p)).  (1.1.5a) 

The  maximum  likelihood  estimators  (MLEs)  of  p and  5 - * based 
on  the  joint  pdf  given  in  (1.1.5)  and  (1.1.5a)  are  given  in  Bain 
(1978).  But  he  did  not  study  any  properties  of  these 
estimators.  Tests  for  p for  unknown  t,  * are  given  in  Wright  et 
al.  (1978).  Other  than  the  above,  we  are  not  aware  of  any  estima- 
tion or  hypothesis  testing  study  in  Type  I censoring  with  replace- 
ment from  the  location-scale  exponential  distribution. 

For  sampling  without  replacement,  n items  are  put  to  test 
whose  failure  times  are  iid  with  pdf  given  in  (1.1.1).  In  this 
situation,  everytime  an  item  fails,  it  is  not  replaced.  We  denote 
by  Xj,...Xn  the  failure  times.  The  ordered  failure  times  are 
denoted  as  before  by  ^ <...<  X^n^.  We  observe  only  if  it  is 
less  than  or  equal  to  t so  that  the  number  of  failures  in  this 
case  is  given  by  R = [X_ <tj  » where  IA  = 1 if  the  event  A 

happens,  and  1^  = 0,  otherwise.  Thus,  in  this 
case  R ~ Bin  (n,  1 - exp(-  ?(t  - p))). 

The  joint  pdf  of  the  ordered  failure  times  and  R is  obtained 
as  follows. 

Conditional  on  R = r (>0)  the  joint  distribution  of 

W = X . . - p, . . . ,W  = X.  . - p is  the  same  as  that  of  r order 
1 (1)  r (r) 

statistics  from  a random  sample  of  size  r from  an  exponential 
distribution  truncated  at  t - p.  Now  appealing  to  Theorem  2.2  in 
page  51  of  Bain  (1978),  one  gets,  the  joint  pdf  of  W^,...,W 
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given  R = r (>0)  as 


f(w  ,...,w  |r)  = r!  n {exp(-  £w  )/(l  - exp(-  c(t  - p))J 

i=l 


Hence , 
f(x 


(!>>••• > (r) 


r) 


i. 

= r!  n {exp(-  C(xf .v-n))/(l  -exp(-  e(t-p)))}  (1.1.6) 

i=l 

Since  R ~ Bin  (n,(l  - exp(-?( t-p) ) ) ) , it  follows  from  (1.1.6) 
that  the  joint  pdf  of  X^ ^ , . .. ,X^r^  and  R is 

i r r 

f (x(  1)  > • • • »X(r)  jr)  "(n-r)!  {exp(-?(x^^  - p)J 


• (exp(-(n-r)c(t-p)}  for  r = 1,2, ...n;  (1.1.7) 

P(R  = 0)  = exp[-n?(t-n) ] . (1.1.7a) 

In  this  situation,  MLEs  of  p and  are  obtained  in  Bain 
(1978),  and  tests  for  p treating  J as  a nuisance  parameter  are 
given  in  Wright  et  al. 

Multisample  extensions  of  the  ideas  described  earlier  are  as 
follows.  Suppose  that  for  some  k > 2 the  experiment  consists  of 
putting  nj,...^  items  to  test  independently.  Also,  the  lifetimes 
of  all  these  items  are  independently  distributed  and  the  lifetimes 
of  the  items  in  the  ith  group  have  common  pdf 

f(x)  — C^axp(- £jx  - i=l , . . . ,k  (1.1.8) 

Let  t^  denote  the  censoring  time  for  the  ith  group,  and  let  R^ 
denote  the  number  of  failures  occurring  before  time  t^ 

(i=l,...,k).  It  is  assumed  that  p^  < t.  for  all  i = l,...,k.  For 
sampling  with  replacement,  within  each  group,  an  item  failing 
before  the  censoring  time  is  either  repaired  or  replaced.  Let 
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X(-Xi)  * ...<  X^r  ^ denote  the  ordered  failure  times  for  the  ith 

group  when  r.  > 0 (i  =l,...,k).  Note  that  for  ^=0, 

min  X > t . Define  S = {i  : r > 0}  and  S = { j : r = 0| 
l<j  <n±  1J  1 1 J J 

(S  or  S can  be  empty  with  positive  probability).  Then  general- 
izing (1.1.5)  and  (1.1.5a),  the  joint  pdf  of  x( ) > ’ * * »X( iR. ) ,Ri 
(i  = l,...,k)  is  given  by 

f(x(ll),...,X(iri),ri,...,x(ki),...,x(krk),rk) 


= n {(n-C..-)  1 exp(-n  r. (t  -n.))lr  .} 

ieS  ill  l ^i^di)^*  ’ *<x(ir  )<t:i^ 


• { n_eXp(-n  r (t  -n  ))} 
ieS  J J J J 

For  sampling  without  replacement,  generalizing  (1.1.7)  and 
(1.1.7a),  one  gets  the  joint  pdf  of  x(n)  » • • • >x(iR.  ) 
(i=l,2...k)  given  by 


(1.1.9) 


f (x 


(ll)»---»X(iri),r1,...,x(ki),...,X(kr  ) 


» • • • > rk ) 


n.!  c.  x r. 

ltS  ~i  - ri)'  - V 


- H [ 


i 


n_  [exp(-n  r(t  - n.))]. 


jeS 


J J J 


(1.1.10) 
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1 • 2 The  Present  Research 

In  this  dissertation  we  address  several  estimation  and  hypo- 
thesis testing  problems  involving  location  and  scale  parameters  of 
the  exponential  distribution  in  one  and  many  sample  situations. 
First  consider  Type  I censoring  with  replacement.  In  this  case, 
in  Chapter  Two  we  have  characterized  the  class  of  unbiased  estima- 
tors for  functions  involving  the  location  and  scale  parameters  for 
the  one  and  two  sample  problem.  The  end  conclusion  is  that  for 
most  of  the  parameters  of  interest,  there  does  not  exist  any 
unbiased  estimators.  The  results  can  be  easily  generalized  to  the 
multiple  sampling  case,  but  we  have  refrained  from  doing  so  to 
preserve  algebraic  simplicity.  In  Chapter  Three  we  have  consider- 
ed maximum  likelihood  estimation  of  location  and  scale  parameters 
in  one  and  two  sample  cases.  The  asymptotic  distribution  as  well 
as  the  mean  squared  error  (MSE)  of  the  MLE  is  obtained  in  this 
section.  Also,  an  asymptotically  unbiased  estimator  for  the 
location  parameter  is  proposed  which  achieves  asymptotically  50% 
MSE  reduction  than  the  MLE.  Next,  in  Chapter  Four,  we  focus  on 
generalized  likelihood  ratio  tests  ( GLRT)  for  the  equality  of  the 
location  and/or  the  failure  rates  of  k independent  location  and 
scale  parameter  exponential  when  censoring  times  for  the  k groups 
are  possibly  distinct.  For  testing  the  equality  of  the  failure 
rates,  asymptotic  distributions  of  the  GLRT  criterion  are  obtained 
both  under  the  null  hypothesis  and  under  local  alternatives.  For 


testing  the  equality  of  the  location  parameters,  asymptotic  null 
distributions  of  the  GLRT  criteria  are  obtained. 

From  Chapter  Five  onwards,  the  without  replacement  case  is 
considered.  In  this  case,  MLEs  of  the  location  and  scale  para- 
meters as  well  as  their  asymptotic  distributions  are  obtained  both 
in  the  one  and  two  sample  cases.  Modified  MLEs  for  the  location 
parameter  achieving  MSE  reduction  over  the  MLEs  are  also  introduc- 
ed. Unlike  the  with  replacement  case  a complete  characterization 
of  parametric  functions  admitting  unbiased  estimators  seems  diffi- 
cult here  owing  to  the  complexity  of  the  distributions  of  the 
minimal  sufficient  statistics.  It  is  shown  however  that  neither 
the  location  nor  the  scale  parameter  is  unbiasedly  estimable 
either  in  the  one  or  in  the  two  sample  cases. 

Finally,  in  Chapter  Six  GLRTs  are  derived  for  testing  the 
equality  of  the  location  parameters  and/or  the  failure  rates.  The 
asymptotic  distributions  obtained  are  very  similar  to  their  coun- 
terparts in  the  with  replacement  situation. 


CHAPTER  TWO 


UNBIASED  ESTIMATION  FOR  THE  WITH  REPLACEMENT  CASE 
2.1  Introduction 

In  this  chapter  we  consider  unbiased  estimation  of  functions 
of  location  and  scale  parameters  of  exponential  distributions  in 
one  as  well  as  two  sample  problems,  where  observations  are  censor- 
ed in  time  and  sampling  is  done  with  replacement. 

Our  objective  is  to  characterize  estimable  functions  (i.e. 
those  which  admit  unbiased  estimators)  of  location  and  scale 
parameters.  The  one-sample  case  is  considered  in  Section  2.2.  As 
a consequence  of  the  main  characterization  result  in  this  case,  it 
follows  that  if  both  the  location  and  scale  parameters  are 
unknown,  any  function  involving  only  the  location  parameter  is  not 
estimable.  In  addition,  neither  the  scale  parameter  nor  its 
reciprocal  (the  failure  rate)  is  estimable.  However  if  the  scale 
parameter  is  known,  any  differentiable  function  of  the  location 
parameter  is  estimable,  while  if  the  location  parameter  is  known, 
any  power  series  in  the  failure  rate  is  estimable. 

A similar  investigation  is  pursued  in  Section  2.3  for  the  two 
sample  case.  Several  cases  are  considered  which  include  those 
where  the  location  and/or  scale  parameters  are  equal.  Estimable 
parameters  (if  any)  are  characterized  in  all  these  cases.  Unlike 
the  one  sample  case,  one  or  the  other  failure  rate  is  sometimes 
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estimable  in  the  two  sample  problem  if  it  corresponds  to  the 
population  for  which  the  censoring  time  is  larger. 

2.2  Unbiased  Estimation  in  the  One  Sample  Problem 

Suppose  n items,  whose  lifetimes  have  pdf  (1.1.1),  are  put  to 
test  in  an  experiment  of  fixed  duration  t.  Since  testing  is  done 
with  replacement  and  with  all  the  assumptions  this  kind  of  sam- 
pling implies,  then  the  joint  pdf  of  failure  times  and  R is  given 
by  equation  (1.1.5)  namely 


a \ , -nt(t-n)T 

f(X(1),...,X(r),r)=(nc)  e I 

P(E  , 0)  = e_n?<t‘n). 


[n<x^j<...<x^j<t] 


r = 1,2. . 


Recall  that  when  R = 0,  ^ > t,  so  we  define  Xq ^ as  the  time  of 

the  first  failure  if  it  is  less  than  t and  X^^  = t otherwise. 

In  addition  Wright  et  al.  (1978)  have  shown  via  the  factori- 
zation criterion  that  (x(1),  R)  is  sufficient  for  (q,?).  The 
following  lemma  shows  that  it  is  also  complete  and  gives  its  pdf 
Lemma  2.2.1  The  statistic  (Xq^,R)  has  pdf  given  by 


f(x  r)  = ^ — (t- 

Ux(i),r;  U 


xo)) 


r-1  -ns(t-q) 


n < 


X(D<C 


r = 1,2, 


P(R  = 0,  X(1)  = t)  = e nC(t  n)  (2.2.1) 

and  the  family  of  distributions  induced  by  X^  and  R is  complete. 
Proof  The  fact  that  (x(i)»R)  has  pdf  given  by  (2.2.1)  is  easily 
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seen  by  writing, 

f(X(i),r)  = f(x^  |r)P(R=r).  for  r = 1,2. 
so  that  using  Lemma  1.1.2, 


f (x. Jr)  = ft- ••  / C 
( 1 ) 1 x/  , \ x 


r! 


Also,  for  r=0. 


dx , v • • • dx  / \ 
(l)  x(r-l)  ( t— n) r (r)  (2) 

r(t'x(l))r_1 

"“(tv  ,n<x(1)< t; 


(2.2.2) 


(2.2.3) 


P(X(1)  = t I R=0)  = 1 (2.2.4) 

Hence,  combining  (2.2.2)  through  (2.2.4)  and  using  the  fact 
that  R ~ Poisson  (n£(t-p))  (by  using  Lemma  1.1.1,  in  Chapter  One) 
we  obtain  (2.2.1). 

To  show  completeness,  let  h(X^\,R)  be  a measurable  function 
°f  (X(i),R)  such  that  ?h(X^^,R)  = 0 for  all  pe(0,t],  ?>0. 

This  last  statement  implies  that 


E 

r=l 


It 


r (t-x)r 

h(x,r)(n?)  ^ , dx  + h(t,0) 


= 0 


(2.2.5) 


for  all  pe(0,t] , £ > 0. 

Since,  for  a fixed  p,  (2.2.5)  is  a power  series  in  £ then 
after  equating  coefficients  of  £r  on  both  sides  one  gets 
h( t ,0)  = 0 

/^nh(x,r)-^^~x))  dx  = 0,  r > 1.  (2.2.6) 


Fix  p > 0 and  choose  p e(0,t]  such  that  p < p.  Then 

* , O O 

of"1 


ft  , , x fn(t-x) 

>n  nh(x’r)  (PTT T 


dx  = 0. 


(2.2.7) 
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Subtracting  (2.2.6)  from  the  above  expression  one  gets 
/JJ  h(x,r)nr  , dx  = 0 


C 


for  all  0 < Pq  < p < t. 

Writing  s(x(1),r)  = h(x(1),r)  nr 

then 


s(x,r)dx  = 0 for  all  p ,p  e ( 0 , t ] 

such  that  Pq  < p and  r > 1,  if  and  only  if 

s+(x,r)dx  = /n  s (x , r)dx 
^o  ^o 

The  last  statement  is  true  if  and  only  if 

/g  s (x,r)dx  = /B  s (x,r)dx  for  all  B e 
where  = a-algebra  of  Borel  sets, 
which  in  turn  means 

s+(x(l),r)  = s (x(i)>r)  a,e*  for  11  < x(i)  < c*  and  r > 

i.e. 

s^X(i)  »r)  = 0 a«e.  for  p < x^  < t and  r > 1 
which  means 

h(x(i),r)  = 0 a.e.  for  p < x^  < t and  r > 1. 

Hence 

h(x(l)>r)  = 0 a.e.  for  p < x^  < t,  r > 0.  □ 

Note  that  since  (x^^,R)  is  complete  sufficient  for  (p, 
a parametric  function  h(p,£)  is  estimable,  using  the  Rao- 


.2.7) 


.2.8) 


1 


O,  if 
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Blackwell-Lehmann-Scheffe  (RBLS)  Theorem,  there  exists  a UMVUE  of 
h( q , ?)  based  on  (x^,r). 

This  shows  that  if  there  does  not  exist  any  unbiased  estimator 
of  h(n,C)  based  on  (x^),r),  h(ri,£)  does  not  have  an  unbiased 
estimator. 

The  first  main  result  of  this  section  is  as  follows. 

Theorem  2.2.1  h(n,C)  is  estimable  only  if  h(n,c)  is  of  the  form 
h(n,C)  = Er  _ Qur(n)^  ’ where  Uq(p)  does  not  depend  on  n and 
ur(t)  = 0 for  r>l. 

Proof  Suppose  h(q,£)  is  estimable.  Then  there  exists  some 
statistic  g(X^,R)  such  that 

En  ?g(X(i)»R)  = for  all  n < t,  and  ? > 0.  (2.2.9) 

This  means  via  Lemma  2.2.1  that 

h(n , C)  = Er=1/^g(x,r)  exp[-n?(t-n)](n?)r(t-x)r  1 / ( r-1 ) ! dx 

+g(t,0)  exp[-n?(t-n)],  (2.2.10) 

for  all  q < t and  x,  > 0. 

Note  that  for  every  fixed  q,  the  right  hand  side  of  (2.2.10) 
is  a power  series  in  £ so  that  the  left  hand  side  of  (2.2.10)  must 

also  be  a power  series  in  £.  Thus  h(n,C)  must  be  of  the 

00  r n 

form  Er_QUr(ri)c  . Equating  now  the  coefficient  of  £ on  both 

sides  of  (2.2.10),  one  gets  uQ(q)  = g(t,0)  for  all  q(<t)  which 

oo 

shows  that  Uq(p)  does  not  depend  on  n»  Also  E u (t)^r=g(t,0)  for 

r=0  r 

all  x,  > 0 which  implies  that  ur(t)  =0  for  all  r > 1 and  uQ(t)  = 
g(t,0).  □ 
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Note  that  we  are  tacitly  assuming  the  convergence  of  the 
00 

power  series  E u (q)?r  for  all  £ e (0,»).  In  what  follows,  we 
r=0  r 

assume  all  power  series  encountered  to  be  convergent  over  the 
range  of  possible  values  of  the  failure  rates. 

Remark  1 It  follows  as  a consequence  of  Theorem  2.2.1  that  a 
function  u(q)  is  not  estimable  unless  u(ri)  is  a constant.  In 
particular,  there  does  not  exist  any  unbiased  estimator  of  the 
location  parameter  q.  Also,  the  scale  parameter  j;  ^ is  not  esti- 
mable, because  it  cannot  be  expressed  as  a power  series  in  £. 

Thus,  we  have  narrowed  down  the  entire  class  of  parametric 

functions  h(q,£)  to  parametric  functions  of  the  form  E°°  u (q)rr 

r=0  r 

(where  Uq(ti)  does  not  depend  on  q)  as  potential  candidates  for 

being  estimable.  The  next  theorem  characterizes  all  estimable 

functions  within  this  class,  where  u^(q)  is  differentiable  in  q. 

Theorem  2.2.2  Suppose  ur(x)  is  differentiable  in  x < t. 

00 

Then  Er_QUr(q)£  admits  an  unbiased  estimator  based  on  ^ and  R 
if  and  only  if  Uq(p)  does  not  depend  on  q and  uf(t)  = 0 for  all 
r * 1*  Furthermore,  the  class  of  unbiased  estimators  of 
differentiable  (in  q)  parametric  functions,  consists  exactly  of 
functions  of  x and  r which  are  continuous  in  x for  x e (0,t), 
r > 1. 

Pro°f  Necessity  has  been  established  on  the  previous  theorem.  To 
prove  sufficiency  assume  g(x,r)  is  a continous  function  of  xe(0,t) 
for  r >1.  Then,  using  (2.2.1)  one  gets 

Er=0Ur^?r  = Er=  1 » r)  Cnc)rexp  (— n^C  t— n)  ) C t-x) r 1/(r-l)!dx 
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+g(t,0)exp(-n£(t-n))  (2.2.11) 

for  all  q < t,  £ > 0.  This  implies  that 

(2”=0ur(p)?r)(E“=0(n?(t-n))r/r! ) 

= 2r=1nr?r/^g(x,r)(t-x)r  1 / ( r— 1 ) ! dx  + g(t,0),  (2.2.12) 

for  all  ri  < t,£  > 0. 

Equating  the  coefficients  of  ?r(r  > 1)  on  both  sides  of 
(2.2.12),  one  gets 

vr(n)  = S^=0u  (n) (n(t-q) )r  ^ / ( r— j ) ! 

= /^g(x,r)nr(t-x)r  V (r-1) !dx,  (2.2.13) 

for  all  q < t.  Note  that  vQ(q)  = uQ(q)  = g(t,0)  for  all  q < t. 
Now  differentiating  both  sides  of  (2.2.13)  with  respect  to  q,  and 
then  writing  x for  q,  one  gets 

g(x,r)  = -n  r(t-x)r  ( r— 1 ) ! v'(x),  x < t,  r > 1.  (2.2.14) 

Using  (2.2.14)  and  the  fact  that  vf(t)  = ur(t)  = 0 for  r > 1 and 
vQ(t)  = uQ(t)  = g(t,0) , one  gets 

E[g(Xd)»R)]  = [-^r=1Cr/^v'(x)dx  + g(t,0)]  exp  (-nc(t-n)) 

= [Er=1 Cr(vr(h)  - vr(t))  + g(t,0)]  exp(-n?(t-n)) 

= [^”=0Cr(vr(n)  - vr(t))  + g(t,0)]  exp(-n?(t-q)) 

={sr=0Cr^j=0uj(h)(n(t-n))r  ^ / ( r-j ) ! }exp(-nc(t-n)) 
- 


□ 


(2.2.15) 
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Note  that  since  an  estimator  has  been  constructed  using  a complete 
sufficient  statistic,  it  follows  via  RBLS  that  it  has  minimum 
variance  in  the  class  of  all  unbiased  estimators  of  this  paramet- 
ric function. 

Next,  let  gQ(x,r)  be  a possibly  discontinuous  (in  x) 
function,  whose  expectation  hQ(p,s)  say,  is  differentiable  in  p. 

By  Theorem  2.2.1  and  the  first  part  of  Theorem  2.2.2  it  follows 
that  hQ(p,5)  must  be  of  the  form  E r_QUr(p)?r  where  Ug(p)  does  not 
depend  on  p and  ur(t)  = 0 for  r > 1.  But  for  such  a parametric 
function  by  the  second  part  of  Theorem  2.2.2,  we  can  construct  an 
unbiased  estimator  g(X,R)  which  belongs  to  the  class  of  functions 
of  x and  r which  are  continuous  in  0 < x < t for  r > 1.  This 
implies  that  E (g  (X,R)  - g(X,R))  = 0 all  pe(0,t],  t.  > 0 which 
in  turn  means  that  gQ(X,R)  = g(X,R)  with  probability  one,  by 
completeness  of  x(]j  and  R. 

Hence,  only  functions  of  X^ 1 ^ and  R which  are  continuous  in 
X(d  for  p < < t,  and  r > 1 can  be  unbiased  estimators  of 

parametric  functions  h(p,£)  which  are  differentiable  in  p. 

Remark  2 It  follows  from  Theorem  2.2.2  that  the  failure  rate  £ 
itself  is  not  estimable.  Indeed,  any  non-constant  power  series 
k(?)  of  £ is  not  estimable  where  the  coefficients  in  the  power 
series  do  not  involve  p.  However,  the  function  exp{-n?(t-p)}  is 
estimable.  Indeed  the  function  I[r=q]  -'•s  t^ie  UMVUE  Qf  this  esti- 


mable function. 
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Remark  3 In  the  case  when  r)  is  known,  it  can  be  seen  from  (1.1.5) 
and  the  factorization  criterion  that  R is  sufficient  for  £.  Since 
R ~ Poisson  (n£(t-ri))  it  is  well  known  that  it  has  a complete 
family  of  pdfs. 

The  following  lemma  characterizes  the  class  of  estimable 
functions  in  the  RBLS  sense  for  this  situation. 

Lemma  2.2.2  If  R ~ Poisson  (n?c) , where  c is  a known  constant, 
then  a parametric  function  K(?)  is  estimable  if  and  only  if  it  is 
a power  series  in  £. 

Proof  Let  g(R)  be  an  unbiased  estimator  for  K(?).  This  implies 


that 


WO  - CnS(r)  ?V"CC,  0 < ? < ». 


(2.2.16) 


'r=0£' ' r ! 

Since  the  right  hand  side  of  (2.2.16)  is  a power  series  in  £, 
we  must  have 


K(0  = S”=0  ar£r  0 < ? < ». 

To  prove  sufficiency  write,  from  (2.2.16)  and  (2.2.17) 

CoVr-  ^ <re-°CC 

This  implies  that 

rrvr  o (nc)r~J  _ r”  r / \ (nc)r 
Er=0?  Ej=0aj  ( r-j ) ! Ej=0C  g(r)  r!  * 

Equating  coefficients  on  both  sides  we  obtain 


g(r)  = 


r! 


(nc)r 


Er  a -Ls.?.)r  J 

j=0aj  (r-j)! 


Hence, 


°o  r r I 

Eg(R)  = E [ 

r=0  ( . 

(nc) 


r (nc) r ^ 

- E a 

r j=0  j (r-j)! 


for  r > 0. 


(n?c)  -n?c 


r! 


= z"  rrZr  a lnc)r~J 

r=0?  J =0aj  (r-j)!  6 


(2.2.17) 


(2.2.18) 


(2.2.18a) 
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a 

r 


,°°  (nc)r 
r=0  r! 


Remark  4 Suppose  now  £ is  known,  but  p is  unknown.  In  this  case 

is  sufficient  for  p,  and  has  pdf  given  by 

f(xa))  = nc  exp[-n?(x^-p)  ] if  p < x^  < t.  (2.2.19) 

P(X^  = t)  = exp(-n?(t-p) ) (2.2.20) 

Theorem  2.2.3  X^ ^ ) has  a complete  family  of  distributions. 

Proof  Let  g(X^j)  be  a measurable  function  of  X^^  such  that 

Er]g(X^^)  = 0.  Using  (2.2. 19)-(2.2.20)  if  follows  that 

q^h)  = /^ne  exp[-n£x]g(x)dx  + g( t)exp [-n?t]  = 0 (2.2.21) 

Chose  p"e(0,t  ) such  that  p"  < p,  then 

9 j (p"*  ) -q  1 ( h ) = /^g(x)n?  exp(-n?x)dx  = 0 
* 

for  all  0 < p < p < t,  which  follows,  if  and  only  if 

/^g+(x)n?exp(-n?x)dx  = /^„g  (x)n£exp(-n?x)dx  (2.2.22) 
Put  q2(x)  = g (x)  n?  exp(-n^x) . Then  (2.2.22)  implies  that 

/B  q2(x(l))dx  = /g  q2(x)dx  for  a11  B e S (2.2.23) 

where  B = o-algebra  of  Borel  sets. 

Equation  (2.2.23)  is  true  if  and  only  if 

V*(n>  = 92^X(1)^  ^or  a^most  aH  x(i)  G (h,t) 

i.e.  if  and  only  if 

q2^X(  1)  ) = ^ ^°r  a-*-most  a 11  x(i)  e (h,t) 

which  in  turn  means 

g(x(l))  = 0 for  almost  all  ^ ^ e (p,t).  (2.2.24) 

Using  (2.2.24)  and  going  back  to  (2.2.21)  it  follows  that 
g(X(^)  = 0 for  almost  all  p < x^^  < t. 
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In  this  case,  any  differentiable  function  u(ri)  admits  an 
unbiased  estimator  g(X^)  if  and  only  if  u(t)  = g(t).  In  such 
case  g(x^p  is  necessarily  continuous  for  n < x^  ^ < t. 

To  see  this  note  that  if  g(X^))  is  an  unbiased  estimator  of 
u(n),  where  u(n)  is  differentiable  in  n,  one  has 

u(h)  = /^g(x)n?exp(-n?(x-n))dx  + g(t)exp(-n(t-q)) . (2.2.25) 

which  implies  u(t)  = g(t). 

Next,  assume  g(xQ^)  is  continous  in  for  n < x^^  < t, 

and  g(t)  = u(t).  Then 

u(n)exp(-ncn)  = /^g(x)n£exp(-n£x)dx  + g(t)exp(-n?t) . (2.2.26) 
Differentiating  both  sides  of  (2.2.26)  with  respect  to  n < t,  one 
gets 

(u'(n)-n£u(n))exp(-n<;ri)  = -g(  Ti)n?exp(-n?p)  . (2.2.27) 

From  (2.2.27),  one  gets 

g(x(1))  = u(xd))  ~ u'(x(1))(n?)-1  if  h < x(1)  < t.  □ 

Also,  using  the  fact  that,  g(t)  = u(t),  it  follows  that  g(X^)  is 
the  UMVUE  of  u(n).  In  particular  n has  the  UMVUE 
X(l)  " 1 [n  < x(1)  < t]. 

It  also  follows,  using  familiar  arguments,  that  only  functions 
that  are  continuous  in  x for  ri  < x < t qualify  as  unbiased  estima- 
tors of  u(q),  where  u(q)  is  differentiable. 

Note  in  (2.2.25)  that  if  u(p)  is  estimable  but  not  necessari- 
ly differentiable  we  must  still  have  u(t)  = g(t). 
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2.3  Unbiased  Estimation  in  the  Two  Sample  Problem 

Suppose  that  two  independent  sets  of  items  are  put  to  test, 
where  the  first  set  contains  n^  elements,  while  the  second  set 
contains  n2  elements.  As  in  Section  2.2,  a failed  item  is 
replaced  instantaneously  by  a similar  item.  Recall  from  Chapter 
One  that  the  lifetimes  for  items  in  set  i are  assumed  to  be  iid 
exponential  with  location  parameter  n^,  and  failure  rate 
(i=l»2),  while  replacement  items,  on  the  ith  group,  have  indepen- 
dent lifetimes  with  location  parameter  zero  and  failure  rate  . 
The  censoring  times  for  these  two  sets  are  denoted  by  t^  and  t2« 
Assume  that  < t^  ( i= 1,2).  We  denote  by  the  number  of  fail- 
ures before  time  t±  for  the  set  i (i=l,2).  Then  from 
Lemma  1.1.1,  Chapter  One,  R^'s  are  independent  with  R^  ~ 

Poisson  (ni?i(ti  - ) ) , i=l  ,2. 

Given  R^  = r^  (>  0),  the  ordered  failure  times  for  the  set  i 
say  < ...  < X^r  ^ are  the  ordered  values  of  a 

random  sample  of  size  r^  from  the  uniform  (p^,t^)  distribution, 
also  define  = t.  if  R±  = 0 (i=l,2). 

Several  cases  need  to  be  considered.  First  consider  the  case 
when  ri ^ C \ and  ?2  are  a -*■-*-  distinct  and  unknown.  In  this 
case,  the  joint  pdf  of  all  the  observations  is  given  by  (1.1.9), 
in  Chapter  One,  and  by  the  factorization  criterion  (X^jj,  ^(21)’ 
Rl,  r2^  is  sufficient  for  (n1}  ti2,  Cj,  ?2) * Their  joint  pdf  is 


given  by 


-24- 


f(X(n),x(2i),ri,r2) 

r . 


- 1 (ni;i>  (r  .v1 

i-l  (rl-1)!  1 X<11)  6 I[ni<X(iij<ti]  * 


for  r ^>0,  r2>0 


= e 


-iilni!i(ti'1i)  (n2t2) 


r2-l 

(t„-x,„.x)  I 


(r2-l)!  A(21)'  "^2<x(21)<t2] 


for  rx-  0,  r2  > 0 


= e 


Jl  Vl'W 


1 


""I”1 

( r : — 1 ) ! (tl  X(ll))  I[n1<  x(n)<  tj] 


for  r1  > 0,  r2  = 0 


= e 


- i= ! Vi(W 


rl  ■ °>  r2  ‘ 0 


(2.3.1) 

Theorem  2.3.1  ^(n)»^(21)*  ^l » ^2^  bas  a complete  family  of 

distributions . 

Pro°f  Let  h(X^ ^ ^ ,X^ 2i ) > Rj , R2)  be  a measurable  function  of 

(X(  1 1 ) ,X(  21 ) ’ Rl>  V such  that  En1h2?1?2  h(X(  1 1 ) ,X(  21 ) ’ Rl>  R2)=0 

for  all  n^CO.tj],  n2 e(0 , t2 ] , ^ > 0 and  5 > 0. 


Then 


h(X(11>,X(21)>  Rl*  V ~ 

En2C2En1?J  h(X(ll)’X(21)»  Rl»  R2) lX(21)’R2^  = 0 

By  independence  ^ 1 1 ) ,X(21 ) ’ R1 5 R2^  1^(21)  ^2^ 

n1?1  h(X(ll),X(21)»  Rl»  r2)  and  En1C1h(X(ll)’X(21)’  Rl»  R2}  = 


= E 
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§(hj_»  x(2l)»  R2^  (say)  is  not  a function  of  n2  or  ?2  since  the 

parameters  are  all  distinct  i.e.,  when  integrating  with  respect  to 

(X( 11) »Rl> 

g(n1»C1.X(21),R2)  = Eni>?1(h(X(11),X(21),  Rj,  R2)) 
is  still  a statistic,  i.e.  it  does  not  depend  on  any  unknown 
parameters  of  the  distribution  of  (X^^,  R2).  Hence, 

El1l112ClC2h('X(11),X(21),Rl,R2'1 

= En2?2Eri1cJh(X(ll)’X(21)’Rl’R2)  = Ep2?2g(T1l)Cl’X(21)’R2)  = ° 

By  completeness  of  (X^2jj,R2)  this  implies 

g(ni’Cl’X(21)’R2)=En1?1h(X(ll)*X(21)’Rl’R2)  = ° 

for  all  n2e(0,t2],  ?2>0. 

Then  for  all  n^e(0,t^],  £^>0  and  by  completeness  of  (X^^,R^), 

^^X( 11 ) ,X(21) ’ Ri»  R2^  = ® with  probability  1.  □ 

Next  by  straightforward  generalization  of  Theorem  2.2.1  we 
obtain  the  following  result. 

Theorem  2.3.2  A parametric  function  h( , ri„  , g , g ) is  estimable 


only  if  it  is  of  the  form  Z 


r ^=0  r 2=0 


ri  r2 

V.r./Wh  c2 


where  uQ  does  not  depend  on  nor  n2,  uQ  ^ ( n i » ^2 ) does 

not  depend  on  for  r2  > 1,  u^_  q(Pj,P2)  does  not  depend  on  p2 
1°L  rl  > 1 and  ur  (tl,t2)  = 0 for  (r^^)  * (0,0), 

Ut1,0<tl’n2>  ‘ 0 for  rl  > *•  uQii  (nj,t2)  - 0 for  r2  » 1 andjll 
rij^eCO ,t  x ] , p2e(0,t2] . 

Proof  Suppose  h(n1,b2,C1,S2)  is  estimable.  This  in  turn  implies 
that  there  is  some  statistic  §(x( \ i ) »X( 2\ ) » Ri>  R2^  such  that 
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En1,n2,?1,?2g(X(ll)’X(21),RrR2)  (2.3.2) 

for  all  0 < nx  < tp  0 < n2  < t2,  t,l  >0,  ?2  > 0. 

Using  equation  (2.3.1)  in  combination  with  (2.3.2)  and  writing 

U1  = X(ll)  and  U2  = X(21)’  one  gets 

h(n1,n2>?i»?2)  = 


: : r£i  a .'-w 

l A,  \ s s(ui,u2'ri-r2>n7T)!_  o^T)i 


rl  r2 

(n  c ) (n,c_)  1 


r2=l  r X=1  "l  "2 
r,  -1 


r„-l 


1. 1 i l 2 i z. 

(tj-Uj)  (t2-U2)  exP[  E “ nici(ti-qi)]du2du1 


i=l 
r , 


” <Vl}  r 

+ S_, ^n, g(ui»t2*ri*0^  (V-i)"  (trui> 


r -1 


r -i  V'-1’'2’'1”"  ^r1* 


•exp[  E - nici(ti-qi)]du1 
i=l 


00  t, 


(n2C2) 


+ rE=/h2  g(ti«u2»°‘r2)  (r2-l)!  (t2"u2) 


r2"1 


exp[  E - n. C.(t.-ni)]du2 


i=l 


Z. 

+ g(t  ,t  ,0,0)  exp[-  E n. c. (t .-q. ) ] 

i=l  1 1 1 1 ■ 


(2.3.3) 


for  all  0 < nL  < tj,  0 < n2  < t2,  q > 0,  q > °* 

Note  that  for  every  fixed  n1  and  n2,  the  right  hand  side  of 

(2.3.3)  is  a bivariate  power  series  in  q and  q.  Therefore 

Mq,q,q  >?2^  must  be  of  the  form 
oo  co  r r 

E 1 ur  r (h1.h2)c11C22. 
q=0  r -0  rl’r2  1 2 1 1 


(2.3.4) 
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Equating  the  coefficients  for  ^ 5^  on  both  sides  one 

gets  u0,0(T1rn2)  = g(t1»t2»°>°)  for  a11  h^CO.tJ,  n2e(0,t  ] 
which  implies  that  Uq  o^r'l,r|2^  ^oes  not  depend  on  nor 


00  OO 

and  Z 
rl 


rl  r2 


z ur  (t  ,t  )?  ? = g(t  ,t  ,0,0)  for  all  > 0, 

=0  r =0  r!>r2  1 z 1 z 1 z 1 


> 0 which  implies  that 

Ur  ,r  (tl*t2)  = (°»°)  for  ^ri’r2^  * (°>°) 
and  U0,0(tl’t2)  = g(t1»t2«0>°)* 

0 r2 

Note  also  that  equating  the  coefficients  of  £ £ , r > 0 

X Zi  z 


we  get 


uq  j.  (hj  jT^)  §(bj,t2,0,0) 


(n2(t2-n2)) 

r ! 

2 


+ Z Z 


r2  ^n2^t2_T12^  ^ 


r2=!  J2=0 


V 


| s(tj,U2>0,r2  j 2) 


n„ 


VJ2 


r2_j2"1 

(t0-u0)  du2,  for  n1 £(0,t1 ] ,n2e(0,t2] 


(r2_j2_1)!  2 2 
which  shows  that  u^  ^ (r^,^)  does  not  depend  on 

3nd  U0,r  (nl’t2)  = g(t1»t2»°»°) 


r2  - 0 


= 0 


r > 1 
2 r 


Likewise  for  r^  > 0,  equating  the  coefficients  of  We 

obtain 


Urx  ,0^nl,T12^  g(t1>t2»°»°)  r^t 


rrJi 


+ z z 

ri=i  J -0 


h (WV)  1 ,ci  , , . n. 

\ s(u1,t2,r1-Jl,0)  Trrjrl), 
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W1 

• (tj-u^  1 1 dux 

for  n^eCOjt^],  n2E(0>t2]  which  shows  that  q^.t^)  does  not 
depend  on  p2  for  r^>l 

"d  Ur1,0(tl>"2)  ' s(tl-t2'°’0)  ri  ’ 0 

=0  rx  > 1 □ 

Accordingly,  any  non-trivial  parametric  function  involving 

and  ti2  only  is  not  estimable.  Also,  a function  K(?1,?2)  is  estim- 
able only  if  it  is  a bivariate  power  series  in  ^ and  £2.  Thus, 
the  scale  parameters  and  are  not  estimable. 

Our  next  result  generalizes  Theorem  2.2.2  to  cover  our  pre- 
sent case. 

Theorem  2.3.3  A parametric  function 

OO  OO  T T 

1 2 

2 ^ u„  „ (h,,Ti0)c,  where  uA  n(p,  ,rir,)  does  not  depend 

rl=°  r2=0  1’  2 1 1 1 Z U’U  1 L 

on  nj  and  n2,  Uq  r^(p^,ri2)  does  not  depend  on  for  r2  > 1,  and 
ur^  ,0^1  ,T12^  does  not  depend  on  n2  for  r^  > 1 and  which  is  differ- 
entiable in  Tij  and  p2,  admits  an  unbiased  estimator  if  and  only  if 

Ur1  ,r2^tl’t2^  = 0 £or  (ri>  r2  ) * (°»°)»  urx  ,0^1  ’n2^  = 0 for  rl  > 
1,  and  uo,r2^nl ft2)  = 0 for  r2  > 1 for  a11  0 < < tl  and  0 < n2 

< t2. 

Proof  Necessity  has  been  established  in  Theorem  2.3.2. 

To  prove  sufficiency  assume  g(u^ ,u2 ,rj ,r2)  is  continuous  in 
hf  < ui  < tj,  n2  < u2  < t2  for  (rlsr2)  * (0,0).  Then  using 
(2.3.3)  and  (2.3.4)  one  gets 


OO  OO 


[ 2 2 u 

rl-°  r2'°  r‘ 
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- : (ni(trV) 1 (wv) 2 ri  r2i 

•i  E 1 — ft ?i  s2  1 

rx=0  r2=0  rr  r2  ’ 1 Z 

°°  ” ^1  rt2  (Vi)  1 <n2?2}  2 

‘ r'-l  r2-l  J"l  J"2  g<"l’U2,rl,r2)  <VD! 

rl_1  r2_1 

• (tj-Uj)  (t2-u2 ) du2du1 


1 


” Si  (nl?l}  ‘ rl-1 

+ rE_i  /T1ig(ui»ti»ri»°)  VV  _1  ' ~ O^-u,)  du 


( r x —1 ) ! v 1 T 


1 


00  t. 


(n2?2) 


V1 


+ rE=1  K2  g(ti>u2»°’r2)  (r2-l ) ! (t2  U2)  du2 


+ g(t1,t2,o,o) 

for  all  nj^eCO,  tL  ] , n2e(0,t2],  q > 0 , ?2  > 0.  (2.3.5) 

r 1 r2 

Equating  the  coefficients  of  5 5 on  both  sides  of  (2.3.5), 
one  obtains  that  for  u < n1  < t1 , 0 < n2  < t2,  rx  > 1 , r2  > 1 


ri  r2 


(n  (t.-n.)) 

Tr  _ (n,,n9)  = E E u (n,,n9) — — c,- ■ 

rl’r2  1 2 j ^=0  j 2=0  VJ2  1 2 (rrV! 


rrJi 


(n2(t2  n2)) 


r2"J2 


(r2  j2)! 


^ 1 ^2  ^2  n2 

= ^nl  ^2  S(Ul’U2’rl’r2)  ( r 2 — 1 ) ! (r2-l) 


rl"1  r2-1 

(t^-u^)  (t2~u1)  du2du^ 


r^l.r  >1;  (2.3.6) 


Note 


that  in  (2.3.6)  when  at  least  one  n.  = t . , v „ (rii,no)  = 0 

1 1 r 1 > ^2  1 z 


Also,  for  0 < n2  < t2,  r1  = 0,  r2  > 1 
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2 (n,(t,-n,)) 

v0,r,("l-,,2)  ' ,£  „ u0,j,(W 
2 


r2-J2 


2 ‘ " jo=0  U’J2  x ‘ ('r2~^2')! 


rt2  r (n2?2^  r2 

" •^nog^tl’u2’0,r2)  (r.-l ) ! (t2_u2) 


du,. 


(2.3.7) 


And  for  0 < n ^ < t1 , r1  > 1 , r2  = 0. 


1 ^n1(t1-n1)) 

rr1,0(nl’n2)  = ,|=0  uj1,0(nl#n2)  (r1-j1)! 


rrJi 


r -1 


Aij  g(ul’t2,rl’0)  ( r L — 1 ) ! ^"“l*  dul 


(2.3.8) 


V0,0(W  = u0,0(VV  = g(t1»t2»0»0»)  (2.3.9) 

for  all  0 < n1  < tp  0 < n2  < t2. 

Then,  for  r^  > 1 , r2  > 1,  differentiating  (2.3.6)  with 
respect  to  both  < t^  and  ri2  < t2  and  writing  for  and  u2 
for  n2  one  gets 


g(u  ,u0  ,r  ,r  ) = 


( r x —1 ) ! (r2-l)! 


1 * 2 * 1 * 2 r r r -1  r -1 

nl  n2  ^t2_U2^  ^ 


32vr  r (» i»u 2) 
ri,r2  1 2 


3u1}3u2 


(2.3.10) 


Likewise  from  (2.3.7)  and  for  r1  = 0,  r9  > 1 and  n9  < t 


’2  N 2 


g(t1,u20,r2)  = 


(r2-l) ! 


r2,  .r2  1 

n2  (t2'u2) 


V0,r2(tl,u2) 

3u„ 


(2.3.11) 


v0,r  (h1,n2^  does  not 


In  (2.3.11)  we  have  used  the  fact  that 


-31- 


depend  on  p^.  From  (2.3.8)  and  for  > 1,  r2  = 0 and  p^  < 


(r  -1)! 

g(u1>t2,r1,0)  = 


3vr1,0(ul't2) 


1 ri_1  9U1 

ni  (tl“Ul) 


(2.3.12) 


Here,  in  (2.3.12),  we  have  used  the  fact  that  v n(hi.Po)  does 

, u i t 


not  depend  on  p2> 

2 

Define  b = Z nrft-p  ), 
i-i  1 1 1 1 


Then,  using  (2.3.9)  through  (2.3.12)  and  the  fact  that 

V0,0(tl,t2)  = U0,0(tl,t2)’  Vr1,r2(T1l,t2)  = ° f°r  ri>  °’ 

r > 1 and  v (t  ,p  ) = 0 for  r.  >1,  ro>0 
^ rl  ,r2  1 L ^ ^ 


we  obtain 


Eg(U1,U2,R1,R2)  = 


00  t t 

1 /‘/,2 


e b(r1-l)!  (r 2-l ) ! 


r X=1  r2=l  *1  n2  rl  r2 


x x.  rl_1  r2-1 

nl  n2  ^ 1 -u  1 ^ ^ t2~u2  ^ 


^2\,r2(ul’u2)  (n151)ri(t1-u1)ri  * (n2c2)r2(t2-u2)r2  ‘ 


3u^  3u2 


(rrl)! 


(r2-l ) ! 


du^du2 


“ t e b( r — 1 ) ! 

* C 1 


3Vr, ,0(ul’t2)  (n1?1) 


r -1 


r =1  nl  rl 


ni  (trV 


rl_1 


3u , 


11  (,  > 1 , 

~r_rl)!(tl-ul)  dul 


- I / 


t2  e b(r2-l)! 


r =1  ''2  r2  r2  1 

2 n2  (t2-2) 


3v  (t  ,u„)  r2 

0,r2  1 2 (n2?2) 


3ur 


r2_1 


(r£-l ) ! (t2_U2)  du2 
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+ g(t1,t2,0,0)e 


-b 


00  00 


. r t t s2vr  r (“i-u2) 

-[t  E ?,  C, L f du,,du, 

r =1  r =1  1 2 ^1  n2  3u,  3un  2*  1 


1 2 


12 


00  t r 9vr  0^U1 
v / 1 /l  1’  2 

, n,  3u, 


du. 


ri  = i 1 


oo  t r 9v0  r ^1 ,u?^ 

/„ 2V-4^ ^2  + g<tl>t2,0,0,]e- 

00  oo  XT  r t 

' ‘r'.l  ^ - \Vr2 <ul’"2))dul 

+ rf=l  5l’  (vr1,0<"l't2>  -Vr1>0(tl't2)) 

00  ■£ 

+ 522  (v0,r2(tl'”2)  - ''0,r,(tl’t2))  + S(t 1 ■ C2 >° ' 0) ]e 


oo  oo  r r 

12 


[ ^ ^ ^1  ^2  ^Vr  r ^ti»t2^  vr  r 

ri=i  r2=i  2 r!  ,r2  1 2 ri’r2  1 2 


oo  oo  T“  T 

1 2 


E Z C1  C2  (Vr  r (tl>ri2)  “ Vr  r (VV) 
ri=i  r2-i  2 r!»r2  1 2 rl’r2  1 2 


" r, 


00  r. 


V-l'1  WW*5*  W*1*V 

1 r2_1  2 


+ v0,0(tl't2>b 


-b 


00  OO 


rl  r2  « 


[ E E vr  r (nl’n2)?l  h + Z vr  n(nl  1 

rl=i  r 2=1  rl’r2  1212  j-i=1  ^.0  1 2 1 

oo  j- 

+ /-l  V0,r2("l-,’2)522  + ''0,0(tl-t2)]o'b 
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= [ E E v (n. 
r1-0  r2=0  rl,r2  1 


-b 

e 


r r 

00  °°  r,  r„  1 2 


[ E E ^\22 


r^=0  r2=0 


(njCt i-n ,)) 

E E u j (n1,n2) (7-_j  }, 

jj-o  j2=o  JrJ2  ^ i 


rrJi 


(n2(  t 2 b2 ) ) 


VJ2 


-b 


(r2~j2)! 


rl  r2 


[ E E ur  r 

r =0  r =0  ri’r2 


00  00 


'[  E EC 
r^=0  r2=0 


ri  Vr 

rl  ^nl^t  1_T|1  ^ ^ r2  (n2^t2_T12^ 


V 


r2! 


00  CO 

E E u 


rl  r2 

‘r  r ^2  * 

r -0  r2=0  rl’r2  1 1 1 Z 


-b 


(2.3.13) 


Furthermore  as  in  the  one  sample  case,  only  functions  of 
(u1,u2,ri,r2)  which  are  continuous  in  u^  and  u2  for  < u^  < t^ 
and  ti2  < u2  < t2,  (r^,r2)  * (0,0  ) can  be  unbiased  estimators  of 
differentiable  (in  and  n2)  parametric  functions  that  satisfy 
all  the  assumptions  stated  in  the  theorem.  □ 

We  consider  next  the  case  when  n^=n2=p  but  and  c2  are  not 
necessarily  equal.  Again,  we  characterized  estimable  functions  of 
the  form  h(p,c^,C2^’  With  this  end,  first  the  following  theorem 
is  proved.  Let  z = m;*-n(x(  ^ ^ ) ,x(  21 ) ^ anc*  ^or  definiteness,  let  t^ 


-34- 


Theorem  2.3.4  (Z,R^,R2)  is  complete  sufficient  for  (n,£^,£2). 

Proof  First  via  Lemma  1.1.9  in  Chapter  One,  we  write  the  joint 
pdf  of  x(ii)>***»x(iRi).X(21^,...,X(2R^,  Rx  and  R2  as 

f (x( 11 ) » — ,x(lr1)’x(21)’,#* ,x(2r2),rl’r2) 

2 ri 

= * {(n.C. ) exp(-n  5 (t  -n)) 

i-1  ill 


[h<x 


(il) 


,<t.]d  r >0,  r >0; 
(it.)  1 


f(x(2i),...,x(2r  ),0,r2) 


(2.3.14) 


2 

= (n2?2)  exp(-  E ^^(^-n)) 


i=l 


• T y NO • 

[n<x(21)<”,<x(2r  0)<t2]>  2 


(H),...,X(ir  ),ri,0) 

2 


= (n^)  1exp(-  E n1?i(ti-n)) 


i=l 


(2.3.15) 


[T1<X(  ll)^1  — <X(  lr  1)<tl  J ’ ri>°’ 
, 2 

f(0,0)  = exp(-  E n.?  (t.-Ti)). 

i=l  11  1 


(2.3.16) 

(2.3.17) 


Note  that  in  (2.3.15),  and  (2.3.16),  one  can  write  the  indicators 
as  I[ti<z]  since  in  the  former  case  z = min(  1 1 ,x^  21  ^ ) , while  in  the 
latter  case  z = min(x^^,t2).  Thus,  it  is  easy  to  see  from 
(2.3.14)  - (2.3.17)  that  (Z,R^,R2)  is  sufficient  for  (h,C^,C2). 

To  prove  the  completeness  of  Z,R1  and  R2,  we  need  first  their 
joint  pdf  denoted  here  by  q(z,r1,r2).  To  this  end,  consider 
T1  < z < min(tpt2)  = tj.  Also,  we  will  write  u^  = and 
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U2  = x( 2 1 ) * Tben  independence  of  groups  P(z  > z,  R^=r ^ »R2=r2^ 
= P(UX  > z,  U2  > z|R1-r1>R2-r2)P(R1-r1)P(R2-r2) 

= P(UX  >z|Ri=r1)p(R1=r1)p(U2  > z|  R^jPtR^) 

= [p(z<U1<t1|R1=r1)+p(U1=t1|R1=r1)]p(R1=r1) 

•[p(z<U2<t2|R2=r2)+P(u2  =t2|R2=r2)]p(R2=r2)  (2.3.18) 

Hence,  using  (2.2.3)  - (2.2.4)  in  (2.3.18)  and  the  fact  that 
marginally  R^  ~ Poisson  (n±ci(t— n) ) (i=l,2,...),  and 
simplifying,  one  gets  for  p < z < t^. 


P(Z  > z .R^r^  R2=r2) 


rl  r 

(n  r (t ,-z))  (n  c (t  -z))  Z 2 

exp [-  l n Q (t  .-p)] 

i=l 


r ! r ! 
1 2 


for  rx  > 1,  r2  > 1; 


(n1?1  (t1-z)rl)  2 

exp[-  E n1^1(ti-p)]  r^l,  r2=0; 


(n2^2^b2 

r2! 


exp [ - E n Ci(ti-pi>]  r^O.r^  1; 


i=i 


exp[-  E (n  r (t  -p)] 
i=l 


rl=°,  r2=0. 


(2.3.19) 

(2.3.20) 

(2.3.21) 

(2.3.22) 


Hence,  by  considering 

P(z<z|R1=r1,R2=r2)p(R1=r1,R2=r2) 

= (l-P(Z>z|R1=r1,R2=r2))P(R1=r1,R2=r2) 
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and  taking  derivates  in  (2.3.19)  through  (2.3.22)  with  respect  to 

z for  ze(n,t1)  we  obtain,  that  for  n<z<tp 

q(z,r1,r2) 

v1  r2  rl  r?~1 

(t  -z)  (t  -z)  (t  -z)  (t  -z)  2 

L (rj-l)!  r 2 ! r^  (r^l)!  J 


r . Z, 

* tt  (n  c ) exp[-  E n r (t  -q)  ] r >1,  r >1  (2.3.23) 
i=l  i=l  1 z 

r2-i 

r2  ( 1 2~ z ) 2 

— ^n2 ^2 ^ (T  — l ) ! sxp [ E — n^£^(t^— q)]  r^=0,r2>l  (2.3.24) 


* (Vi> 


V1 

r1  (t^z)  2 


f)  i exp[  E nic1(t±— n)]  ^>1,^=0  (2.3.25) 


For  z = t, 


= P(Z=tl |R1=ri ,R2=r2)p(R1=r1 )P(R2=r2) 

- [P[U1-t1,U2=t1|R1.r1>R2-t2]  + P[B1.t1,U2>t1|R1^1,R2^2] 
+ P[U1>t1 ,U2=tl | Rx-ri ,R2=r2 ] ]p(R1=r1 ,R2=r2) 

P(Ul=ti ,U2>t1|R1=r1 ,R2=r2)p(R1=r1 ,R2=r2) 

= P(U1=tjR1=r1)p(U2>t1|R2=r2)p(R1=r1)P(R2=r2) 

Thus , 

P(  min  U = t ,R  =r  ,R  =r  ) 
i=l , 2 Z Z 

■ exp[-n1c1(t1-n)  - n2C2(t2-n)]  r1=0,r2=0 


(2.3.26) 
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, .r2  2 


~ (n2^2)  expf-  2 ni?i(tin)]  r^O.r  >1.  (2.3.27) 


i=l 

From  (2.2.23)  - (2.3.27)  it  follows  that  if 


Eg(Z,R1#R2)  = 0 identically  in  neCO.tj],  ?1>0,c2>0  then 


one  must  have 
r*! 


ri -1  r 

2 rir(trz)  (t2~z)  2 


r ! 
2 


ri  r2~^ 

(t  -z)  (t  -z)  2 

+ V-  TtyTTi idz 


r”  ,lIn1g(z,0,r2)[(n2i;2)  2(t2-z)  2 /(r,-l)l]dz 


+ C-ls<tl"°-r2><n2c2)  <t2-tl)  2/t2! 


+ E*  1/I,1g(z,r1,0)[(n1;1)  ‘(tj-z)  1 /(rj-DiJdz 


r -1 


+ g(t1,0,0)  = 0. 


(2.3.28) 


for  aTl  he(0,tj],  and  C2'>^*  The  left  hand  side  being  a 

bivariate  power  series  in  £,  and  £2»  equating  the  coefficient 
ri  r2 

°T  ^2  r2>^-)  on  both  sides,  one  gets 

C’  r, -1 

ft 

'2 


f(h)=/:i1g(z,r1,r2){r21(t1-z)ri  \t  -z/2  + 


r -1 


(2.3.28a) 


+ vl  ( t x — z ) !(t2-z)  2 }dz  = 0 
for  all  netO.tj ] . 

Fix  n < t choose  nQE(0,t]  such  that  no<h.  Then  f(nQ)  = 0 and 
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f(no)-f(n)  = /J[  g(z,r1,r2)[r21(t1-z)  1 (t2~z)  2 

o 

-1  ri  r2_1 

+ rx  (t^-z)  (t2-z)  ]dz  = 0 (2.3.28b) 

for  all  bo,ne(0,t]  such  that  pQ<p. 

Write  gl(Zfrlfr2)  = gCz.r^^jlr^tj-z)'1  (t^-z/2 

+ r1  (tj-z)  ( 1 2~ z ) 2 } . 

Then 

/J  g1(z,r1,r2)dz  = 0 
o 

for  all  0 < no  < n < tl 
if  and  only  if 


if  and  only  if 

/ B §1+(z»r1»r2)dz  = /B  g1"(z,r1>r2)dz  for  all  B e B 
if  and  only  if 

g1+(z»r1 »r2)  = g1_(z , r: ,r2 ) for  all  n<z<t1,r1>l,r  >1 

if  and  only  if  g1(z,r1>r2)  = 0 which  implies 

g(z  ,r L ,r2>  = 0 for  p<z<t1>  r^l.r^l  (2.3.29) 

Again  equating  coefficients  on  both  sides  of  (2.3.28) 

- 0 r2 

for  CjC2  r2>l,  we  obtain 


r21  r 

rCl  , n _ N r2  (t2_z)  r?  > 2 

Jp  g(z’°’r 2)n2  (r.-l ) ! dz  + g(t  ,0,r  )n  — — ; 

2 L 2’ 


For  fix  q choose  P < p , and  proceed  as  before  to  obtain 


(t„-z) 


r2X 


/n  g(z,0,r2)n2  dz  = 0 for  all  0<pQ<p<t1 


0 
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Hence,  using  the  same  argument 

g(z,0,r2)  = 0 for  all  rKzCtj,  r2>l  (2.3.30) 

Similarly  one  shows  that 

g( z *r1 , 0)  = 0 n<z<t1,  r X>1  (2.3.31) 

Using  (2.3.29)  - (2.3.31)  and  going  back  to  (2.3.28)  one  gets 

r2 

E g(t  ,0,r  )(n  C ) 2 ~ = 0 

r2=0  V 

which  by  uniqueness  of  power  series  implies  that 

g(t1,0,r2)  = 0 for  all  r2  > 0 (2.3.32) 

Hence,  one  must  have  g(z,rj,r2)  = 0 a.e  which  completes  the  proof 

of  the  theorem.  D 

Arguing  as  in  Section  2.2,  it  follows  now  that  if  h(q,£p£2) 
is  estimable,  then  it  must  have  a UMVUE  based  on  Z,  and  R2# 
Also,  if  there  does  not  exist  an  unbiased  estimator  of  h(q,5^,£2) 
based  on  Z,  Rj  and  R2,  then  h(n,?1,?2)  is  not  estimable. 

The  following  theorem  gives  a necessary  condition  for  estima- 
bility  of  h(n,C1,C2). 

Theorem  2.3.5  h(n,£j,£2)  is  estimable  only  if  it  has  the 

r r 

oo  oo  12 

f orm  _Q^r  =Qur  r (u)C^  ?2  where  Uq  q(ti)  does  not  depend  on  q 

and  u (t  ) = 0 for  r,  > 1. 

y r2  J-  1 

Proof  Suppose  h(q,?1,?2)  is  estimable.  Then,  there  exists  a 
function  g(z,r1,r2)  such  that  EgU.R^R^  = h(n,C1,C2).  Using 
(2.3.23)-(2.3.27)  this  implies  that, 

h(n,C1,C2)  = 
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r 1 1 ro 

00  " t (t  -z)  (t  -z) 

r[-l  .{.I  ' - g<Z’rl’r2>[  (.,-1).  r2, 


ri  V21 

(t.-z)  (t„-z)  Z 2 


vtj-z;  kt2~z;  z ri  z 

+ ~ — ”Tr'  '_n  i — ] 17  KO  exp[~  2 n ? (t  -n)]dz 

r ^r2  i-i  11  i=i  1 1 1 


(t„-z) 


rjl 


rl  V 2W  2 

+ E_  g(z,0,r2)-  -(r  _1); (n2c2)  exp[-  £ n^Ct^-n)]  dz 

ro“l  2 i=l 


rx1 

” tj  (t^z)  r 2 

+ E^  g(z  ,r  x ,0)  ~~r  y , (n^)  exp[-E  n.^Ct.-p)  ]ds 

1 1=1 


°°  ^2  ^1^ 
+ E g(t  0,r  ) Z y 

r2=0  z r2 " 


r2  2 


(n  ^ ) exp [-  E n E. (t  -p)]  (2.3.33) 

i=l 


Note  that  for  every  fixed  p,  the  right  hand  side  is  a bivariate 
power  series  in  and  £2« 

Hence  h(p,q,52)  must  be  of  the  form 


00  00 


r r 

z 2 ur  _ (h)?,1?^2* 
r -0  r2=0  rl,r2  1 Z 

For  such  a h(p,£p£2)  with  an  unbiased  estimator  g(Z,RpR2), 
equating  coefficients  of  ^?2  on  both  sides,  one  gets 
u0  0(n)  = for  a11  neCO.tj] 


CO  00 


ri  r2 


and  I I u (t  )?  ? 

r =0  r =0  l,r2  1 1 


1 2 
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v ^t2_t i ) r2 

= I g(tjO,r2) — j ^n2i’2^  which  implies  that 


r2=° 


u 


□ 


_ (t,  ) = 0 for  r,  > 1 . 

Remark  5 It  follows  from  Theorem  2.3.5  that  no  nontrivial  func- 
tion u(p)  is  estimable.  Also,  k(  £^,52)  is  estimable  only  if  it  is 
a bivariate  power  series  in  and  £2*  Thus,  there  does  not 

exist  any  unbiased  estimators  of  the  scale  parameters 

-1  . -1 
?1  and  . 

The  next  theorem  provides  a necessary  and  sufficient  condi- 
tion for  estimability  of  parametric  functions  of  the  form 

» CO  ri  r2 

Tr  =o2r  =oUr  r ^2  which  are  differentiable  in  p(<t1). 

r r 

Theorem  2.3.6  A parametric  function  £°°  E*  u (p)?  * £ ^ 

r j 0 r 2 —0  r ^ , r 2 1 2 

with  u„  _ (n)  differentiable  for  all  n < t,  is  estimable  if  and 
1 1 , r2  1 

only  if  u0>0(p)  does  not  depend  on  p and  ur  r (tj)  = 0 for  r^  > 

1 • Also,  the  class  of  estimators  based  on  (Z,Rj,R2)  which  are 
unbiased  for  differentiable  parametric  functions  consists  exactly 
of  functions  of  (z,r^ ,r2)  which  are  continous  in  z for  p < z < t^ . 
Proof  Necessity  has  already  been  established  the  previous 
theorem.  To  prove  sufficiency,  suppose  g(z,r1(r2)  is  a continous 
function  of  ze(p,t^). 


Let 


. ,rl  ,r2  . , h ("2<t2-z))'r2  ^ 

(z ) ~ =nT  u (z) 


rl>r2  0 J?  0 ' (r,-!,)! 


'1 


'1 


’I  J1 


(r2~j2)! 


P < z<  tj.  (2.3.34) 

Then,  from  (2.3.23)  - (2.3.24)  and  (2.3.34),  it  follows  that 
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00  00 


ri  r2 


Ir1.0Zr2.0Vr1>r2<’l)5l  «2 


r r t 

= E-  r»  /l/2  rc  1. 


rl  r2 


Er1-lEr2-lCl  C2  g(z>rl’r2)nl  n2 

rrl  r2 

f(t1~z)  (t2-z)  2 

(Tj-1 ) ! r2 ! 


(tj-z)  (t2~z) 


V1 


rx!  (r2-l) ! 


}d2 


r2_1 

oo  c i r2  ^2~Z^ 

+ Er2=l?2  t/r,  g(z’°’r2)n2  ~~ (^-1)!  dz 


r2r 


r2  r? 

+ g(t} ,0,r2)n2  (tj-tj)  /r2 ! ] 


+ Ci1/T,lg<z»ri  ,°>ni 1 (ti~z)  1 / ( r x —1 ) ! dz 


r -1 


+ gCtj.O.O), 


(2.3.35) 


rl  r2 


Then  using  (2.3.35)  and  equating  the  coefficients  of  5^5  z on 
both  sides,  one  gets 


V1  r 

r r . (t.-z)  (t_-z) 


Vr1,r2(,l)  " K S(z>r1.r2)nl  n2  ( (Tj-1)! 

+ -^1 (-r  1)s }dz  for  rl  > 1 , r2  > 1;  (2.3.36) 

f,  r r -1 

V0,r  (n)  = g(z»°»r2)(n2  (t2~z)  1 /(r  -l)!)dz 


r2  r2 

+ g(t1,0,r2)n2  (t2-tx)  /r 2 ! for  r2  > 1; 


(2.3.37) 
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t,  r r -1 

Vri>0(Tl)  = /n  s(z»r1,0)(n1  (tj-z)  /(r  1~1 ) ! )dz , 


(2.3.38) 


Tj  > i; 


'o,o(n)  = uo,o(n)  = g(tl’°’0)> 


(2.3.39) 


for  all  n < tj.  Hence,  from  (2.3.36)  - (2.3.38)  differentiation 
with  respect  to  ri  give  for  all  p < t^ 

rT1  r2 

~ri  ~r 2 (ti-n)  (t„-p) 

g(n,r1,r2)  = - n1  n2  [yi 

f.  r2— ^ 

(tj-n)  (t2~p) 


ri! 


}v'  >r  (n)  for  a11  r1>1»r2>1»  (2.3.40) 


2 

g(p,0,ro)=  -n0  ( 1 0— n)  (r  -l)!v'  (n), 

£ u > r2 


-r, 

2'  a2  v"2 


“rl  ~(r i -1 ) 

g( h,r1 ,0)=-n1  (tx-p) 


for  all  r2  > 1;  (2.3.41) 


(r^-l)  !v'  Q(p)  for  all  r^l, 


(2.3.42) 


Also,  from  (2.3.37)  it  follows  that 

r2  0 

V0,r2(tl)  = g(t1»°.r2)n2  /r2!’  r2>1  * (2.3.43) 

Define  g(z,r1,r2)  with  n replaced  by  z in  (2.3.40)  - (2.3.42); 

then,  using  (2.3.34)  — (2.3.35),  (2.3.39)  — (2.3.43)  and  the  fact 

that  v ( t ) = u (t)=0  for  r > 1,  one  gets 

L 1 2 1 T lyT  2 1 1 

Eg(Z,R1R2)  = Iir1=0Zr2=0Ur1,r2(Tl)?l1?22* 
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Hence,  as  before  if  ggtZjR^,!^)  is  an  unbiased  estimator  of 

where  Mq,^,^)  is  differentiable  in  q,  then  we  must 

have  that  gpCz,^,^)  is  continuous  in  z,  because  if  it  is  not 

then  by  the  first  part  of  the  theorem  we  can  argue  that  h( 

r r 

00  oo  12 

- Ej.  =0£r  =oUr  r ?2  where  Uq^q(ti)  does  not  depend  on  q and 

Url>r2^ti^  = ® f°r  > 1.  But,  for  such  a function  by  the  second 

part  of  the  theorem,  there  exists  an  unbiased  estimator  which  is 
continous  in  z < t.  Hence,  by  completeness  of  (Z.RpR^)  the  two 
estimators  are  equal.  [] 

Thus  in  this  case,  the  failure  rate  is  not  estimable 


since  r = E 


00  CO 


ri  r2 


1 ’ hj-O^-O  Ur1>r2<n,‘;l  c2  where  Ur1,r2<r'>  ’ 1 £°r 


^rl,r2^  = an<i  it  is  zero  otherwise  for  all  0 < q < t^. 

Hence  = 1 ^ 0 implies  via  the  theorem  that  is  not 

estimable.  However,  the  other  failure  rate  is  estimable  since 


00  00 


rl  r2 


So  “ 2 £ u (n)?,  c„  where  u (q)  = 1 if 

r^O  r2=0  rl’r2  1 Z rl’r2 

(rl>r2)  = (0,1)  end  it  is  zero  otherwise. 

Hence,  using  (2.3.34)  and  (2.3.40)  - (2.3.43)  one  gets  that 


Vr1,r2(z)  - u0,l(z>  rl 


(njltj-z))  1 (n2(t2-z))  1 


(r 2_1 ) ! 
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and 


1*2 


. (nl 

( c ! -z  ) ) 1 ( 

r9_1 

n2(t2_z))  2 

rl! 

(r2-l)!  r 

rr2f 

ri_1 

(tj-z)  1 

r2  1 
(t  -z)  (t  -z) 

2 i 

(rx-l) ! 

r ! ' r 1 

2 rr 

d_ 

r(n1(t1-z)) 

ri  r9_1 

(n2(t2-z)) 

dz 

[ V 

(r2-l)! 

r2( 

r2~l)(ti_z) 

+ r 1r2(t2~z) 

1 ’ 2' 


.V1 


i-l 


n2 [r2(tl~z)(t2-z)  + rl (t2-z)Z 1 


for  r1>0,r2>l,  and  p < z < t . 


(2.3.44) 


g(tl,°,r2)  n2(t2-t1)’  r2  > 1 


(2.3.45) 


Remark  6 It  is  also  clear  from  the  above  calculations  that  no 

rl 

power  series  of  the  form  £ u (p)£  is  estimable  unless 

rr‘  r‘ 

ur^cl^  = ^ ^or  a ri  * 1 and  Ug(ri)  does  not  depend  on  p.  Thus 
there  does  not  exist  any  nontrival  estimable  function  involving  p 
and  x, i . 

However,  when  £2  is  known , it  can  be  easily  seen  from 
(2.3.14)  - (2.3.17)  that  (Z,Rj)  is  sufficient  for  (p,?l)«  Their 
joint  pdf,  obtained  by  summing  r2  out  from  (2.3.23)  - (2.3.27),  is 
given  by 


-46- 


<Vl> 


r 


1 


fCz.rp  = [r1+n2c2(t1-z>]  — - 


1 ‘ 


• exp[-n1?1(t1~n)-n2c2(z-n)] 


n<z<t1#  r >1; 


(2.3.46) 


fCt^O)  = exp[-(nlc1+n252)(t1-n)]; 


(2.3.48) 


The  following  corollary  shows  that  this  density  is  also 
complete.  However,  the  proof  is  omitted  since  it  is  similar  to 
the  one  given  for  Theorem  2.3.4. 

Corailary  2.3.1  (Z,R^)  has  a complete  family  of  distributions. 

Once  again  our  objective  is  to  characterize  estimable  functions. 

To  this  end  the  following  corollaries  are  obtained. 

Corollary  2.3.2  When  is  known,  a parametric  function  h(p,£j) 

00  r. 

is  estimable  only  if  it  has  the  form  E u (n)?,  and  u (t, ) = 

r =0  rl  1 rl  1 

0 for  ) 1.  1 

Proof  Suppose  g(Z,R1)  is  unbiased  for  h(n,?1),  then  from  (2.3.46) 
- (2.3.48) 


r 


1 


h(n,c1)  = E — — y 


• exp[-n1c1(t1-n)-n2c2(z-n)]dz 
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+ g(t1,0)exp[-(n1c1+n252)(t  -n)].  (2.3.49) 

Since  the  right  hand  side  is  a power  series  in  it  follows  that 

c°  r 

hCn.^p  must  be  of  the  form  Z u (p)£  1 and 

r x=0  ri  1 

” rl 

- Z u = g(t  ,0)  from  which  the  result 

r -0  1 1 

follows.  Note  that  in  this  case  Uq(p)  can  depend  on  p. 


-1  . 


Also,  is  not  estimable  since  it  can  not  be  represented  as 


power  series.  □ 


Corollary  2.3.3  When  £2  is  known,  a parametric  function 

co  rj 

E u C n ) C . which  is  differentiable  in  p for  p < t,  admits  an 
r -0  1 1 

unbiased  estimator  if  and  only  if  u (t,)  = 0 for  r,  > 1. 

rl  1 1 

Furthermore  only  continous  functions  of  z can  be  unbiased  for 
parametric  functions  that  satisfy  these  assumptions. 

Proof  Necessity  has  already  been  proven  on  the  previous 
corollary. 

Hence,  assume  now  that  g(z,r^)  is  continous  for  p < z < t^  and 
ur  (^1)  = Then  using  (2.3.49),  one  gets 


" rl  ri  (n^t  -n)) 

Z ? Z u (p)  t~— 

rj-o'jj-oh  (rrh» 

r* 


rrJ! 


exp[-n  5 p] 


00  (n  £ ) 

rE=0  r^T /T11S(z.ri)[^1+n2C2(t:1-z)](t1-z)  1 


r.  -1 
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x exp[-n2?2z]dz  + g(t1  .Oexp^n^tj)  (2.3.50) 

for  all  n£(0,t^],  > 0. 

Equating  coefficients  on  both  sides  of  (2.3.50)  and  for  n < t 
we  obtain 


v (n)  = Z exp[-n  ? n]u  (q) 


(n^^-n)) 


rrJi 


1 


3l=° 


nl  C1  ‘1  * 

= 7~r  /n  g(z,r1)[r1+n2c2(t1-z)](t1-z)  expf-n^zjdz 

for  r^  > 1;  (2.3.51) 

v0(n)  = exp [-n2?2q ]uq(p)  = g(  z .OJn^exp  [-n^z  ] dz 

(2.3.52) 

Differenting  both  sides  of  (2.3.51)  - (2.3.52)  with  respect 
to  q < t^,  and  putting  z for  q we  obtain 

r . -1 

— g(z,r1  )[r1+n1  c0(t1-z)](t,-z) 


2*2"J  j 


1 


( r 1 1 ) ! 


r -1 


+ g(tx ,0)exp[-n2?2t1] 


d_ 

dz 


n/l 


1 1 
Vr  (z)  = “ 7T"  g(z»r1)[r1+n142(ti~z)](ti~z)  exp[-n2£2z] 

(2.3.53) 


— vQ(z)  = -g(z,0)n2c2exp[-n2?2z] 

Also  from  (2.3.51)  and  (2.3.52), 

v0(ti)  = exp[-n2c2t1]uQ(t1)  = expf-n^t x ] g( t L ,0) 
Using  (2.3.53)  - (2.3.54)  and  the  fact  that 

-n2?2^ i 

v (t.)  = u (t  )e  = 0,  for  r >1,  one  gets 

rl  1 1 

co  r 

Eg(Z,R  ) = Z u (q)5  . 

r =0  1 


(2.3.54) 


(2.3.55) 


Using  familiar  arguments  it  follows  that  the  class  of 
unbiased  estimators  of  differentiable  (in  q)  parametric  functions 
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consists  exactly  of  functions  of  z and  r^,  which  are  continous  in  z 
for  n < z < tj  and  r^  > 1.  □ 

It  follows  from  the  theorem  that  is  still  not  estimable. 


However  ti  = I u (ri)?  , where  u (n)  = 1 if  r,  = 0 and  is  zero 

r x=0  ri 

otherwise,  is  estimable  and  using  (2.3.51)  - (2.3.55)  one  gets 


that  the  UMVUE  is  given  by 


g(Z,R1)  (Z  - ((t_z)  + n2?2)  )I^n<z<(-i  ,Ri>0) 


+ tlI(Z  = t1,R1  =0) 


When  known  but  p and  are  unknown,  it  may  be  easily 

seen  from  (2.3.14)  - (2.3.17)  that  (Z,RZ)  is  sufficient  for 
(ti,^)*  Using  (2.3.23)  - (2.3.27)  their  joint  pdf  is  given  by 


r (n  C (t,-z)) 

f(z,r2)  = [r 2+  n151(t2-z)]  — — 


V1 


x expf-n^^z-n)  - n2?2(t 2~p)  ] n<z<t  , r >1;  (2.3.56) 
= n1c1exp[-n1?1(z-n)-n2?2(t2-n) ] n<z<t x ,r2=0.  (2.3.57) 


P(Z  = t x ,R2=0)  = exp[-n1?1(t1-n)  - 


(2.3.58) 


P(z  t ^ ,R2  r2) 


(n2?2(t:2  ci)) 

~ i 

2 


expf-n^^t^p)  - n2?2(t2-p)]  r2  > 1. 


X 


(2.3.59) 
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Corollary  2.3.4  When  is  known,  (Z,R^)  has  a complete  family  of 
distributions . 

The  proof  is  omitted  because  of  the  similarity  to  the  one  given 
for  Theorem  2.3.4. 

The  characterization  of  estimable  functions  which  are  dif- 
ferentiable in  this  situation  is  given  by  the  next  corollary. 
Corollary  2.3.5  When  is  known,  a parameteric  function 
which  is  differentiable  in  n admits  an  unbiased  estimator  based  on 

00  J* 

functions  of  (Z,R2)  if  and  only  if  it  has  the  form  Z u (n)?„2. 

r2=0  r2  2 

Also,  the  class  of  unbiased  estimators  of  differentiable 
parametric  functions  consists  exactly  of  functions  of  z and  r2 
that  are  continuous  in  z for  n<z<t^  r2  > 1. 

Proof  Suppose  g(Z,R2)  is  unbiased  for  h( n , C2 ) . Then, 
from  (2.3.56)  - (2.3.59) 


oo  £ t 

h(n,C2)  = Z -~-j  /ri1g(z,r2)[r2+n1?1(t1-z)](t2-z) 

r 2 -0  2 


v1 


exp[-n1?1(z-n)  - n2c2(t2-p)]dz 


+ Z g(t1.r2) 

r2=° 


(n2(t2  't  j ) ) r. 


x exp[-n1c1(t1-n)  - n2^2(t2_Tl)^ 

for  all  0 < n < tj,  ?2  > 0. 


(2.3.60) 


Again,  the  right  hand  side  of  (2.3.60)  is  a power  series  in 

°°  r? 

C2  therefore,  h(p,£2)  must  be  of  the  form  Z u (p)£  • 

r =0  r2  2 
2 
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Assume  now  that  h(n,C2)  = £ u (n)?9  and  g(z,r  ) is 

r2=0  r2  2 


continuous  for  n < z < tj,  ^ > 1 . 

Then  for  qetO,^]  and  using  (2.3.60) 


°o  r 2 
2 


r2~32 


(n  (t  -n)) 

S ?2  E ui  (n)  (V  -i  ) I exp [-n  £ n] 

r9=0  j2=0  J2  U2  J2;‘  1 1 

r2 

00  (a  £ ) t 

- E ]]  (Cg<2,r2)[r2+nlCl(t2-2)](t2-z) 


r2~‘ 


X expf-n^zjdz  + g(t  x ,r2)(  t2-t  l )exp  [-n^t  l ] } (2.3.61) 

Equating  coefficients  on  both  sides  of  (2.3.61),  we  obtain 


(n  (t  -n)) 


r2-J2 


v (n)  = I U (n)  - 2(r2  ■ ), 

2 j =0  J2  ^r2  V’ 


"Vln 


(2.3.62) 


C1  n2 


r -1 


“ /n  ~yp-  g(z>r2)[r2+n1C1(t2-z)](t2-z)  exp[-n1  C^zjdz 
(n  (t  -t  ))  2 

+ g(t1,r2)  — expf-n^tj  , r2>0  (2.3.63) 

for  ne(0,t^]. 

Differentiating  both  sides  of  (2.3.63)  with  respect  to  n < tj 
and  putting  z for  q,  one  gets 


d n2  r _ 1 

vr  (z)  = 7T_g(z»r2)[r2+n1c1(t2-z)](t2-z)  2 expf-n^z] 


for  r2  > 0. 

00  x* 

Also  from  (2.3.60)  with  h(q,?2)  = E u (q)£  2 

r2=0  r2  2 

(n2(t2't:i))  2 

Vr2(tl)  = S(t1,r2)  — expf-n^tj,  r2>0. 


(2.3.64) 


(2.3.65) 
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Hence,  using  (2.3.64)  - (2.3.65),  one  gets 


00  J* 

Eg(z,R  ) = z u (n)^2. 

r2=0  r2  Z 

Again,  familiar  arguments  show  that  only  functions  that  are 
continous  in  z qualify  as  estimators  of  differentiable  parametric 
functions.  Also  note  that  if  a function  Mt^,^)  is  estimable  but 
not  necessarily  differentiable,  then  we  must  have  that  it  is  a 
power  series  in  £ 2*  □ 

Hence,  it  follows  using  (2.3.62)  and  (2.3.64)  - (2.3.65)  that 
ri  is  estimable  with  UMVUE  given  by  the  function 


(2 


g(Z,R2)  Z + nl?l)1 

Also  ?2  is  estimable,  again, 
.3.65);  its  UMVUE  is  given  by 


(h  < Z < tj, 
using  (2.3.62) 


R2  > 0) 


and  (2.3.64)- 


n2R2^R2~1') 


R„ 


g(Z,R2) 


[n2(t2-Z)j2  + Vl  n2(t2-Z) 
R2 

(t2-z)  nl?l 


(n<z<t1 ,R  >1) 


n2(t2~tl)i  (Z  = R2  > 


This  apparent  anamoly  in  the  behavior  of  power  series  in 
and  s2  is  due  to  the  fact  that  the  censoring  times  t^  and  are 

distinct  and  t^t2*  situation  reverses  when  < t^. 
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If  both  and  ?2  are  known,  then  only  Z is  sufficient  for  p, 
its  pdf  may  be  obtained  from  (2.3.46)-(2.3.48)  or  (2.3.56)- 
(2.3.59)  and  is  given  by 

f(z)  = (n1?1+n2?2)exp[-(n1?1+n2c2)(z-n)]  p<z<t1;  (2.3.66) 

P(Z  = tx)  = exp[-(n1?1+n2c2)(t1-p)]  (2.3.67) 


This  case  is  very  similar  to  the  one  sample  situation  when  £ 
is  known.  Hence,  any  differentiable  function  u(p)  admits  an 
unbiased  estimator  if  and  only  if  u(t1)  = g(t1).  Also  only  con- 
tinuous functions  of  z can  be  estimators  for  differentiable  para- 
metric. In  such  case  the  UMVUE  is  given  by 

g(Z)  = [u( Z)  - u"(z)(n1C1+a2^2)_1]I[n<Z<t]  (2.3.68) 

g(tx)  = u(t1)  (2.3.69) 

Hence,  the  UMVUE  for  p is  given  by 
Z - 

If  a function  u(p)  is  estimable  but  not  differentiable  (in  p < t) 
then  u(tj)  = g(t2) 

Remark  7 If  p is  known,  then  from  (2.3.14)— (2.3. 17)  (R1,R2)  is 
sufficient  for  (C1,?2)»  its  pdf  is  given  by 

r , r„ 


P^Ri  rl»  R2  T2) 


(n1?1(tl-p))  1 (n2C2(t2-p)) 


V 


r2  ! 


x exp[-n1?1(t1-p)-n2?2(t2-p)]  (2.3.70) 

which  is  the  joint  density  of  two  independent  Poisson  variables. 
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Hence,  using  arguments  similar  to  those  used  in  all  other 
cases,  it  follows  that  a parametric  function  is  estimable  if  and 
only  if  it  is  a bivariate  power  series  in  q and  £2«  In  particu- 
lar, both  and  £2  are  estimable.  Indeed  the  UMVUEs  of  ^ and  ^ 

« * 

are  given  respectively  by  ^ and  x,^  with 
?i  = R^n^^-p)  (i=l , 2) . 

In  general  the  UMVUE  of  any  function  of  the  form 

00  oo  T*  T 

1 2 

E E a _ 5 e is  given  by 
r :=0  r2=0  1’  2 


g(Rx,R2)  = 


Rl! 


R2! 


R1 

(n^tj-Ti))  (n2(t2-p)) 


R„ 


R1  R2 

x l la.. 

jj-0  j2=0  J1’J2 


■Rrji 


(n^tj-n))  (n2(t2-n)) 


R2  j2 


(RrV! 


(R2-j2)! 


(2.3.71) 


Next  we  consider  the  case  when  and  p2  are  not  necessarily 

equal  but  = ?2  = ^et  R = Rj  + R2*  it  is  easy  to  see  from 

(2.3. 1A)— (2.3. 17)  that  in  this  case  (X^  ^ ^ >^(21 ) is  sufficient 

for  (hi, ho, 5).  Also,  R~Poisson  (c?)  where  c = c(p) 

2 

= l n (t  -n  . ) . 
i=l  1 1 1 


To  obtain  the  joint  density  of  (x( i i ) »x(2i ) > R) > write  W = R2, 
= x(n)»  ^2  = x(21)*  Then  R^  = R-W.  Using  (2.3.1),  one  gets 
§(u1»u2»r,w)  = f(u^ ,u2 ,r-w,w) 
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(t,-u  )r  W 1 w(t  -u„)W  1 

= (r-w)  t \ . — W(n2?2^Wexp^-c?^ 


(r-w) ! 


w! 


= r 


= r 


= e 
For  r > 2 


for 

w>0,  r-w>0 , q^u^t 

, n1<u2<t2; 

(2.3.72) 

• (n1?)r  e_C^ 

r>l,  w=0 , u2=t2; 

(2.3.73) 

r! 

(n2?)r  e“c' 

w=r>l,  u^t  ; 

(2.3.74) 

r! 

c? 

r=0,  w=0; 

(2.3.75) 

r-1 


q(u1,u2,r)  = E f >U2 ,r-w>w) 


w=l 
r-w , . r. 


r~!  (njC)*  w(n2?)i(t1-u1)r  W 1(t2-u2)W  1 
(r-w-1)!  (w-1)! 


-c  X, 


w=l 


= e CC(n1<;)(n2?)  Z 
w=l 


-1  2 (W  ^ • (n  ?(t  -u  ))W  1 


[r-2- (w-1 ) J ! (w-1 ) ! 


= e"c? 


n,n„s2  r-1 


Hi!  E,0  5(t  -u  ))"“* 

w=  1 


-c  nln2^ 

= 6 C?  (r-2) ! (“^(tj-uj)  + V(t2-u2)) 


r-2 


(2.3.76) 


Combining  (2.3.71)  - (2.3.76),  one  gets 
r 

-c  nin2^ 

q(u1,u2,r)  = e C?(r_2)!  (n^t^u^  + n2(t2~u2))r 


-2 


r>2,  qi<u.<ti,  i=l ,2  (2.3.77) 


(trui) 


r-1 


r r j (n^)r  e C?  r>l,  u2=t2>  q^u^Ct^;  (2.3.78) 
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= r 


(t2-a2) 

r! 


r-1 


(n2C)r  e"c5 


r>l,  u^tj,  r)2<u2<t2  $ (2.3.79) 


-c? 


r=0  <=>  Uj-tj,  u2=t2.  (2.3.80) 


Theorem  2.3.7  (U^,U2>R)  is  complete  for  (q^q^S). 

Again  this  proof  is  omitted  because  of  the  similarity  to  the  one 
given  for  Theorem  2.3.4. 

The  next  theorem  provides  a necessary  condition  for  estima- 
bility  of  hCrij  ,p2>^). 

Theorem  2«3.8  h(q^,q2,£)  is  estimable  only  if  it  is  of  the 

OO 

f orm  E Uj-Chj  ,n2)?  , where  uo(hi>Tl2)  does  not  depend  on  q^  and  q2 
and  ur(t1 ,t2)  = 0 for  every  r > 1. 

Proof  It  follows  from  ( 2. 3. 77 )-( 2. 3 .80)  that  h(n1,h2>?)  is 
estimable  only  if  for  each  fixed  q^  and  q2,  it  is  a power  series 
in  £.  Hence,  an  estimable  h(qj,q2,£)  must  be  of  the 

OO 

form  E u^(q^,q  )£  . From  (2.3.77)— (2.3.80)  it  follows  also  that 
r=0  * 

if  g(U1,U2,R)  is  an  unbiased  estimator  of  E u (q,,q9)£r,  then 

0 r=0 

equating  the  coefficients  of  £ from  two  identical  power  series  in 
C(>0),  one  gets  g(t1,t2,0)  = u()(n1,n2)  for  all  n1e(0,t1]  and 
n2e(0,t2]  so  that  Ug(q^,ri2)  does  not  depend  on  q^  and  q2«  Also 

OO 

for  (nx ,n2)  = (tlft2)  one  gets  E u (t  ,t  ) = g(t  ,t  ,0)  from 

r=0  Z 

which  the  conclusion  follows.  D 

A necessary  and  sufficient  condition  for  estimability 

OO 

■jr 

of  E ^^(q^jq^)?  where  each  ur(q^,q2)  is  differentiable  in  both 
r=0 

q^  and  q2  is  given  below. 
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Theorem  2.3.9  Suppose  ur(p^,P2)  is  differentiable  for  every  r 
00 

>1.  Then  £ is  estimable  if  and  only  if  UpChpPo) 

r=0 

does  not  depend  on  and  p2  and  = 0 for  every  r > 1. 

In  such  case  only  functions  of  u^ ,u2  and  r which  are  continuous  in 

Pl  < Ui  < ti  and  p2  < u2  < t2  for  r > 1 can  be  unbiased  estimators 

00 

of  parametric  functions  of  the  form  I u (r'i>P2)?r  which  are 

r=0 

differentiable  in  Pi  and  p2» 

Proof  Again,  necessity  has  already  been  established.  To  show 
sufficiency,  suppose  g(ui,u2,r)  is  continuous  in  u^CPi,^)  and 
^2e^2yt2^  ^or  r > 1*  Then,  it  follows  from  (2.3.77)— (2.3.80)  that 

00  00  {£?  ,n  . (t . -p  . )}r 

[ £ u (p  ,p  )Cr][  Z --1"1  p 1 1 Cr] 

r=0  r=0 


= g(tl,t20)  + ZiCr((r-l)!)'1{/Ti|n^g(u1,t2,r)(t1-u1)r  ^ 


+ ^p„  n2g(ti»u2’r)(t2~u2)  du2^ 


r-1 


00  t t 00 

+ E (cr/(r-2)!)n  n J 2/  ‘g(u  u r)(  E n < t . -u,  »r~2du, 
r=2  1 * n2  ni  1 z i=l  1 


for  all  p,  < t,,  p,  < t9  and  £ > 0. 


du. 


(2.3.81) 


Let 


VVV  = Z u (p  p ) 
j=0  J 


[£i-i  WVir'J 


r=0 , 1 , . . . (2.3.82) 


(r-j)! 

Then  equating  the  coefficients  of  £r  on  both  sides  of 


(2.3.81),  one  gets 
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V0(T11,T12)  = g(ti>t2’0); 


1 l 2 

VvV  = nl^n1s(ul,t2,1)dul+n2^r1  g(t1»u2»1)du2; 


vr(nl  »n2)-C(r-2) ! 3 lnin2/Ti^n1lg(ul»u2’r)^r=lni(ti"uj 


+ c ( r-1 ) ! ) 1[/T1|nig(u1»t2>r)(ti_u1)r  idu! 


+ /T1^n2s(tl’u2’r)(t2-U2)r  idu2^’ 

for  all  n L < t2>  ri2  < t2  and  r > 2.  It  follows  from 

t, 

v1(n1,t2)  = nL  g(u1,t2,l)du1, 


. r-1 


r1(t1,d2)  = n2/ri^g(t1,u2,l)du2,g(u1>t2,l)=-n1i3v1 


and  g(tj,u2,l)  - ~n2 1 (t  ^ ,u2  )/ 3u,,  for  all  u^tj,  u2 
from  (2.3.85),  one  gets, 

X1lg<-ul,t2,r)(tl_ul)r_1/(r~1)!  = 3v1(u1  ,t2)/3Ul  for  Uj 
n2g(t1,u2,r)(t2-u2)r_1/(r-l)!=3vr(t1,u2)/3u2  for  u£<t 
Further,  from  (2.3.85) 

( (r-2)  ! ) 1n1n2g(u1  ,u2  ,r)  . -u1 ) )r_2=32vr(Ul  ,u2 

for  u^<tp  u2< 1 2 . Moreover,  using  the  fact  that 

Vr(tl’t2)  = Ur(tl,t2')  = 0 for  r > 1. 

It  follows  that  the  estimator  g(U^,U2,R)  with 


(2.3.83) 

(2.3.84) 
,))r  2dUldu2 

(2.3.85) 
(2.3.84)  that 

(u1,t2)/3u1, 
<t2«  Again, 

<t^  and 

2* 

)/ 3u^ 3u2 

(2.3.86) 


g(ti,t2,0)  - v0(tl>t2)  - ytj.tj) 
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g (u i ,t^ ,r)  = -n1r(t1-u1)  1 (r-1)! (3vr(u1,t2)/3u1),  r > 1, 

g(tl>u2>r)=  -n2r^t2_u2')  ^ 1^r-1)  ! C 3vr  < 1 1 »u2)/9u2)  » r > 1, 

and 


g(u1,u2,r)  = 

( n in 2 ) 1(Ei=lni^ti-ui^)  ^ 2^(r-2)! (82v1(u1>u2^/8ui9u2) 

CO 

for  r > 2 has  expectation  Z ur(r)1 , - 

r=0 

Also,  using  what  has  been  proven  so  far  in  the  theorem  and 
the  completeness  of  Upl^and  R,  it  follows  that  any  function 
gQ(upU2»r)  which  is  unbiased  for  hCp^,^*?)  where  h(n^,h2»C)  is 
differentiable  in  (<t^)  and  ri2  (^2)  must  be  continuous  in 

ulS(Vti)  and  u2e(n2,t  ).  g 

This  completes  the  proof  of  the  theorem. 

Thus,  in  this  case,  the  failure  rate  5 nor  any  function 
uCripT^)  depending  only  on  Pp  or  both  admits  an  unbiased 
estimator  based  on  any  function  of  U^,  l^,  and  R. 

Remark  8 If,  however,  one  of  the  parameters,  say  is  known,  it 
is  easy  to  see  from  ( 2 . 3 . 14 )-( 2 . 3 . 17)  that  and  R are  sufficient 
for  (hj.s). 

From  (2. 3. 77 )-(2 . 3 .80)  we  obtain  their  joint  pdf  which  is 
given  by 

f (u: ,r)  = exp(-c?)n1[n1(t1-u1)  + n2(t2-p2)]r  1?r/(r-l)! 
for  r > 1,  Pj  < Uj  < t ; 


(2.3.87) 


-60 


f(tj,r)  = exp(-cc)  (n2c(t2-n2))r/r! 


2 

Here  c=  E n. (t . -p. ) . 

i=l  1 1 1 


r > 0. 


(2.3.88) 


It  can  also  be  shown  that  this  density  is  complete. 

It  is  easy  to  see  from  ( 2. 3. 87 )-( 2 . 3 .88)  that  if  a parametric 

OO 

function  h(rh,£)  is  estimable  it  must  be  of  the  form  E u (n,)rr 

. r 1 * 
r=0 

where  Uq(p^)  = g(t^,0)  does  not  depend  on  p^. 

Our  next  result  shows  that  this  is  also  a sufficient  condi- 
tion if  h(n^,?)  is  differentiable  in  p^  < t^. 

Corollary  2.3.6  A parametric  function  h(pp?)  differentiable  in 
ri^  admits  an  unbiased  estimator  based  on  functions  of  (U^,R)  if 

OO 

and  only  if  it  is  of  the  form  E u (p  )£r  where  Ug(p^)  does  not 

r=0  r 1 

depend  on  r^.  In  such  case,  the  only  possible  estimators  of 
differentiable  parametric  functions  are  those  that  are  continuous 
in  Uj  for  n1  < u1  < t^  r > 1. 

OO 

Pro°f  Assume  h(pp£)  = E ur(n^)^r  where  Ug(p^)  does  not  depend 

r=0 

on  n1 . Let  g(uj,r)  be  continuous  in  u^  for  u^e(0,t^),  r > 1. 

Then 


OO 


OO 


[ Z ur(h,)cr][  z cr 

r=0  r r=0 


(El.lni(ti-n1,)r 


r! 


00  t . 

= Z ?r/n  g(u1,r)n1 


(n1(t1-u1)+n2(t2-n2))1 


r=l 


(r-1)! 


du. 


" (n2(t2_T12)^r  r 

+ £ g(t,,r)  — C , n < t , c>0  (2.3.89) 

r=0  r'  11 


As  before,  write 
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CEi-in!(trV) 


r-J 


r=0 ,1,2,... 


(2.3.90) 


Equating  coefficients  on  both  sides  of  (2.3.89),  one  gets 

vQ(n1)  = g(t^ ,0)  (2.3.91) 


, , , n^n  (t  -u  )+n  (t  -n2)) 

W ' Jni6<Ul-r)  (F^Ti 

(n2 ( 1 2~ ^2 ^ ^ 


r-1 


du. 


+ r! 


(2.3.92) 


Differentiating  (2.3.92)  with  respect  to  <t^,  aTU*  putting 
u^  for  n1  we  obtain 


3vr(u1) 

9u, 


- n^n^tj-Uj)  + n2(t2-n2)) 
(r-1)! 


r-1 


g(uj,r)  (2.3.93) 


which  implies 


g(u1?r)  = -(r-l)!n11(n1(t1-u1)+n2(t2-p2)} 


Also  from  (2.3.93) 

(n  (t  -n  ))r 

g( tj  ,r)  = vr(tl)(  -i-  2v[  ) 

Using  all  this  information  along 


. 9v  (u  ) 
-(r-1)  r 1 

9u^  1 

u ^ < t^  r > 1. 


r=l , 2 , . . . (2.3.94) 


with  vQ(p1)  = uQ(n1)  = g(t1,0),  one  gets  Eg(U1>R)  = E u^q)^ 

r=0 


Also,  via  completeness  of  ^ and  R and  using  the  results  thus 
far  obtained  in  the  theorem,  it  follows  that  only  functions  of  u^ 
and  r which  are  continuous  in  u^e(0,t^)  can  be  unbiased  estimators 
of  differentiable  (in  n^)  parametric  functions.  □ 
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Hence  p^  is  not  estimable  but  £ is  estimable  and  has  UMVUE 
given  by 


gCUj.R)  = 


R-l 


n1(t1-U1)+n2(t2-n2)  [R>2,n1<U1<t1]  + 
R 


n2(t2~V  [R>1’  Ul=ti] 


Because  of  the  "symmetry"  of  (2.3.77)— (2.3. 80 ) with  respect 
to  Uj  and  u2,  the  case  where  p^  is  known  but  p2  and  £ are  unknown 
can  be  treated  similarly. 

Hence,  if  any  function  h(n2»?)  say  is  estimable  then  it  is  of 
00 

the  form  E u^Cp^s  where  uQ(p2)  does  not  depend  on  p2,  and  this 
r=0 

is  also  a sufficient  condition  when  considering  differentiable  (in 

TI2)  parametric  functions.  In  such  a case  the  only  candidates  for 

unbiased  estimators  are  those  that  are  continuous  in  u2£(0,t2). 

The  UMVUE  of  £ in  this  case  is  given  by 
R-l 


g(U„,R)  = 


n1(t1-n1)+n2(t2-U2)  1 [ R> 2 , p2<U2<t2]+ 


R 


nl(Cl_T1l)  IR>1*  U2=t2^ 

When  both  p^  and  p2  are  known,  R is  complete  sufficient  for 

£.  Also  R~Poisson  ( [n^ ( t )+n2 ( t2~p2) ] ?) . We  already  know  from 

the  similarity  with  the  one  sample  case  with  known  p,  that  for  any 

function  h(?)  to  have  an  unbiased  estimator  it  is  necessary  and 

00 

sufficient  that  it  is  of  the  form  E a tr. 

r 

r=0 
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Hence  from  (2.2.18a)  £ is  estimable  with  UMVUE  given  by 

S3 

R 


C = 


WV+WV ' 


If  £ is  known,  UpU2  are  sufficient  for  (PpP2)  with  pdf 
given  by 

f(u1,u2)  = n1n2^2  exp[-5Z2=1ni(ui-Tii)]ri1<Ul<tl,  n2<u2<t2  (2.3.95) 

f(t1,u2)  = n2cexp[-5(n1(t1-n1)+n2(u2-Ti2) )]  p2<u2<t2  (2.3.96) 

f(ul»t2)  = nlcexp[-5(n1(u1-n1)+n2(t2-n2))]  p^u^^  (2.3.97) 

f(ti,t2)  = exp[-c(n1(t1-n1)+n2(t2-n2))j  (2.3.98) 

Using  familiar  arguments,  it  can  be  shown  that  this  density 
is  complete. 

Furthermore  if  Eg(U^,U2)  = u(n^,n2)  for  some  continuous 
function  g(u1,u2),  then 

t2  C1 

u(n1,n2)exp[-n15n1-n2CTi2]  = 


'2  '1 


n1n2?2exp[-?(n1u1+n2u2)]du1du2 
+ g(uj ,t2)n1?exp[-c(n1u1+n2t2)]du1 


2 

+ /n^gC  t x ,u2)n2?exp[-?(n1t1+n2u2)]du: 


+ g(t1,t2,0)exp[-c(n1t1+n2t2)]  (2.3.99) 

Differentiating  with  respect  to  n2  < t2  and  < tp  and 
putting  u^  and  u2  for  p^  and  p2  respectively,  one  gets 
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3u(u1 ,u2)(n1?) 
3urt 


32u(u  ,u  ) 

L~L~] 

3u23u1 i 


8(1^  ,u2) 

+ [u(ulfu 2)(-n1c)  + — ](-n2c)}  expf-^n^+n^)] 


= g(ux ,u2)n1n2c2exp[-c(n1u1+n2u2)] 


which  implies 

3u(u  ,u  ) 3u(u  ,u  ) 

* U<V"2>  - IT  ~ “ 


2 n2  £ n ^ C 


32u(u1(u2)  j 


3u23“i  n2n2^ 


Similarly 

g<Urt2)  ■ [u(ul>t2)  - 3u 


9u^ul,t2')  1 


1 nl? 


(2.3.100) 


(2.3.101) 


3u(t  ,u  ) 

s(t1,u2)  = [u(t1»u2) 


(2.3.102) 


g(t1,t2)  = u(tlft2).  (2.3.103) 

Hence  if  u^,!^)  is  differentiable  in  rii£(0,tj)  and 

then  u(rij,ri2)  admits  an  unbiased  estimator  if  and  only 
if  u(tj,t2)  = S^tl>t2^’  such  case  only  continuous  functions  of 

u^  and  U2  can  be  unbiased  for  parametric  functions  u(p^,ri2)  which 
are  differentiable  in  and  n 2 * In  particular  both  and 
have  an  unbiased  estimator  which  is  given  by 

"i  ' °i  - - hu, >t.]!  i-1-2 

~ 1 1 

and  via  RBLS,  ^(1=1,2)  is  the  UMVUE  for  n.(i=l,2.). 
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Finally,  we  consider  the  case  when  rij=r)2  = h and  = £2  = 

?•  In  this  case,  using  (2.3. 14)— (2.3. 17) , (Z,R)  is  sufficient  for 
(n,C),  where  Z = min(X^ ii) »X^21 j ) and  R = Rj+R^ 

The  joint  pdf  of  (Z,  R^ ,R2)  is  given  by  (2.3.23)-(2.3.27)  and 
is  denoted  here  by  q(z,r1,r2).  Put  w = r^  then  r2  = r-w  and 
using  (2.3.23)-(2.3.25)  for  q < z < t^,  r > 1,  and 
d = I?_^n^(t  -n) , one  gets 


r 


f(z,r)  = Z q(z,w,r-w) 
w=l 


W-l 


+ Z 
w=0 


r-1  (n1?)w(n2?) 


W.  Vx  X w / • 


1[n1(t1-z)+n2(t2-z))r  1+n2(n1(t1-z)+n2(t2-z))r  1 


e"d? 


("r  - i )T  (n1+n2^r(ni(trz)+n2(t2_z)) 


r-1 


(2.3.104) 


for  r > 1,  n < z < t,  . 


For  z = tj,  using  ( 2 . 3 . 26)— (2 . 3 . 27 ) 
P(Z=t1,  R=0)  = e_d? 


(2.3.105) 


P(Z  = t^  R = r)  = 


r! 


r>l . 


(2.3.106) 
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It  can  also  be  shown  that  (Z,R)  is  complete  sufficient  for 

(n,s). 

Using  (2.3.104)-(2.3. 106)  it  is  easy  to  check  that  if  a 

parametric  function  h(n,?)  is  estimable  then  it  must  be  of  the 
00 

form  E uf(p)£  where  Ug(p)  does  not  depend  on  p.  Our  next  result 
r=0 

characterizes  estimable  functions  within  this  class  which  are  also 
differentiable  in  p(<  t). 

Theorem  2.3.14  A parametric  function  h(p,g)  which  is  differen- 
tiable in  p < t j , admits  an  unbiased  estimator  if  and  only  if  it 
00 

is  of  the  form  £ u^Cn)^  where  uQ(p)  does  not  depend  on  p. 
r=0 

Furthermomre , the  class  of  functions  of  Z and  R that  are 
unbiased  estimators  of  parametric  functions  h(p,£)  which  are 
differentiable  in  p,  consists  exactly  of  functions  of  z and  r that 
are  continuous  in  z for  z e (O.tj),  r > 1. 

Proof  Necessity  has  already  been  established.  To  prove  suffi- 
ciency, let  g(z,r)  be  a continuous  function  of  ze(0,t^)  when 
r > 1.  Then 


r 00  r-  00  (l?_,n.(t  .-p))r?r 

[ E u <n)C  ] [ E — ] 

r=0  r=0  r- 


, r-1 


rrtl  (n  (t  -z)+n  (t„-z)) 

= S c7ng(Z>r)(n1+n.)  — *■  1 , 2 dz 

r=l  n z 


(r-1) 


+ 


Z g(t. ,r)cr 
r=0 


(n2(t2-t1))r 

r! 


(2.3.107) 


for  p < t1 , 5 > 0. 
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As  before,  write 


vr(ti) 


2 u .(n) 

j=0  J 


(Ei,ini(ti-n)) 

(r-j)! 


r~j 


(2.3.108) 


After  equating  coefficients  on  both  sides  of  (2.3.107)  and  using 
(2.3.108)  one  gets 

v0(h)  = = u0(ti)  = 8(^)0)  (2.3.109) 


(n2(t2'ti))r 

Vr(tl)  = 7j r > 1;  (2.3.110) 

For  r > 1,  n < z < t 


Vr(Tl)  = /T11g(z»r)(n1+n2) 
Differentiating  (2.3.111) 


(n1(t1~z)+n2(t 
(r-1 ) ! 
with  respect 


to  n < t 


dz 

I and 


(2.3.111) 
putting  z for 


q,  one  gets 


3v  (z) 
r 

3z 


- g(z,r)(n1+n2) 


(n1(t1-z)  + n2(t2-z)) 
(r-1)! 


r-1 


Using  all  this  information  it  follows  that 


Eg(Z,R)  = £ u (n)£r. 

r=0  r 

00 

Hence  g(Z,R)  is  unbiased  for  £ u (q)£r  and  by  LSRB  it  is 

r=0  r 

also  UMVUE.  Also  using  familiar  arguments  the  only  functions  that 
can  be  unbiased  estimators  of  differentiable  parametric  functions 
are  those  that  are  continuous  in  ze(0,t^)  for  r > 1.  □ 

Thus  in  this  case  q is  not  estimable  but  t,  is  estimable  with 
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UMVUE  given  by 


If  £ is  known,  only  Z is  complete  sufficient  with  pdf  given  by 
f(z)  = (n^+n^s  exp[-(n1+n2)?(z  -p)],  p<z<t1 

f(t1)  = exp  [-(n1+n2)?(t1~p)] . 

Using  the  similarity  with  the  one  sample  case  when  £ is  known 
it  follows  that  any  differentiable  function  u(p)  is  estimable  if 
and  only  if  u(t^)  = g(t^)  and  in  such  case  the  UMVUE  is  given  by 


Again  only  continuous  functions  of  Z can  be  unbiased  estima- 
tors of  u(p)  when  u(p)  is  differentiable. 

If  p is  known,  while  £ is  unknown,  then  R is  complete  suffi- 
cient for  £ and  has  a Poisson  distribution  with 
2 

mean  E n^(t^-p)£.  We  already  know  that  only  functions  of  the 


g(Z)  = (u(Z)  - u'(Z)((n1-Pn2)?)  1 ) [ 1-1 


i=l 


00 


r=0  r 
given  by 


form  E at  are  estimable  and  in  particular  the  UMVUE  for  £ is 


5 - R[  E ni(ti-p)]  1. 


i=l 


CHAPTER  THREE 


MAXIMUM  LIKELIHOOD  ESTIMATION  FOR  THE  WITH  REPLACEMENT  CASE 
3. 1 Introduction 

In  this  chapter,  we  consider  Maximum  Likelihood  Estimation 
(MLE)  under  Type  I censoring  with  replacement.  The  one  sample 
problem  is  considered  in  Section  3.2.  The  MLEs  of  the  location 
parameter  and  the  failure  rate  are  obtained.  The  exact  mean 
squared  error  (MSE)  of  the  MLE  of  the  location  parameter  is  calcu- 
lated. Also,  in  this  section,  a modified  MLE  is  proposed  and  it 
is  shown  to  dominate  the  MLE,  from  the  MSE  criterion,  by  achieving 
asymptotically  about  50%  risk  reduction.  In  addition,  the  pro- 
posed modified  MLE  is  shown  to  achieve  asymptotically  about  100% 
bias  reduction  over  the  MLE.  Asymptotic  distributions  of  the  MLEs 
of  the  location  and  the  scale  parameters,  as  well  as  the 
asymptotic  distributions  of  the  modified  MLE  are  also  obtained  in 
this  section. 

The  two  sample  problem  is  considered  in  Section  3.3.  Several 
cases  are  treated  including  those  where  the  location  and/or  the 
scale  parameters  of  the  two  populations  are  equal.  As  in  the  one 
sample  case,  modified  MLEs  of  the  location  parameters  are  shown  to 
achieve  asymptotically  100%  bias  reduction  and  50%  MSE 
reduction.  Asymptotic  distributions  are  obtained  for  the  MLEs  as 
well  as  the  modified  MLEs  of  location  and  scale  parameters. 


-69- 


-70- 


3.2  Estimation  in  the  One  Sample  Case 

Suppose  that  n itmes  are  put  to  test,  and  the  lifetimes  of 
these  items  are  iid  with  common  pdf 

f(x)  = £exp[-c(x-n)]l|-x  > ,,  (3.2.1) 

where  1^  = 1 if  A happens  and  1^  = 0,  otherwise.  The  duration  of 
the  experiment  is  fixed,  and  is  denoted  by  t.  It  is  assumed  that 
h < t,  since  otherwise  there  are  no  failures.  An  item  which  fails 
before  the  termination  time  is  either  replaced  by  another  item,  or 
is  repaired  and  tested  again.  The  replacement  items  have  an 
exponential  distribution  with  the  same  failure  rate  t,  but  with 
location  parameter  0.  It  is  also  assumed  that  the  lifetimes  of 
the  original  and  replacement  parts  are  mutually  independent. 

It  follows  that  the  joint  pdf  of  failure  times  and  R,  the 
number  of  failures,  is  given  by  (cf  (1.1.5)) 

f<X(D X(r)’r)  ’ <»C>r«p[-nC(t-r,)]l 

(1)  (r) 

r=l , 2 , . . . 


£<x(i)’0)  * exp['ns<t-,,)]I1X(i)>tr 
Note  that  the  parameter  space  for  (n,£)  is  (0 , t ] x(0 ,<*>) . 

From  the  previous  chapter  we  know  that  (X^,R)  is  minimal 

sufficient  for  (p,?)  with  pdf  given  by  (2.2.1). 

The  MLEs  of  p and  £ are  given  respectively  by 


p = if  p < < t 


= t if  x(1)  > t, 

and  5 = { R/ (n( t-p) ) } I 


(3.2.2) 


[P  < t]  * 


(3.2.3) 
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First  we  consider  estimation  of  n.  Note  that  using  (2.2.19)- 
(2.2.20)  the  MLE  r)  has  MSE  given  by 

E("“n)2  ' Et(X(l)-")2l[n<x(1)<tj]  + (t-n)2P(x(1)>t) 

= 2(n 4)  X[l-{l+n?(t-n)}  exp(-nc(t-n))]*  (3.2.4) 

In  order  to  motivate  the  modified  MLE,  first  observe  that 
when  £ is  known,  the  UMVUE  of  p is  given  by  p-(n£)-^I  <t] 

(see  Section  2.2).  When  £ is  unknown,  we  substitute  £ for  5 in 

/s 

the  above  UMVUE  expression,  and  get  the  modified  MLE  p of  p as 

a 

J - CC)-1!  . (3.2.5) 

V.  I ) 2 

The  next  theorem  provides  the  MSE  for  p. 

Theorem  3.2.1 

E(;-I1)2  , E(n%)2  - (t-n)*E[R(R+»-|R+2)  X(R>2]].  (3.2.6) 


Proof 


E(P-P)2  = E(p-p)2  - 2E[R-  (X(1)-p)(t-X(1))I[n<X(i)<t]] 

+ e[r  ^"x(1))2l[n<X(^<t]]'  (3.2.7) 


From  (2.2.1)  and  the  fact  that  R~Poisson  (n?(t-p)),  the 
conditional  pdf  of  X^ ^ given  R = r(>0)  is  given  by 

f(X(l)|r)  = r(t-x(1))r-1/(t-p)r,  p<  x(1)<t.  (3.2.8) 

Hence,  for  r > 0, 


E[<t~x(i))2lh<x(1)<t]lR"d 


E 


[(t-X 


/^{(t-x)2r(t-x)C  1/( t-p)r }dx 
(l))(x(i)-n)I[p<X(i)<t] lR=r] 


(t-p)2r/ (r+2) ; 


(3.2.9) 
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= /^(x-n)(t-x)r(t-x)r  1 ( t— n)  rdx 


= r/^(x-n)(t-x)r(t-n)  rdx 


= r(  t— ti)2/qZ(  l-z)rdz  = r(t-ri)2(r+l ) *(r+2)  (3.2.10) 

From  (3.2.7),  (3.2.9)  and  (3.2.10),  it  follows  that 
E(n-r02  - E(n-n)2  + (t-n)2  E([R(E+2)  - (r+i  )(R+2)h(R>i] ) 


- E(S-n)2  - (t-n)2  E(  [r(r+i)(r+2)  h[R>^] ) • <3-2-m 

This  completes  the  proof  of  Theorem  3.2.1.  □ 

Next  we  investigate  the  asymptotic  behavior  of  the  two 

A A 

MSE's  E(p-ri)2  and  E(p-p)2.  More  precisely,  the  following  theorem 
is  proved. 

Theorem  3.2,2 

^ —9 

(i)  n2  E(p-p)2  2£  a£  n -*■  «;  (3.2.12) 

a 

A O 

(ii)  n2  E(p-p)2  ->•  £ as_  n -»■  °°. 

Proof  (i)  is  an  immediate  consequence  of  (3.2.4).  To  prove 

(ii),  note 

n 

X Y 

that  n'^t-q)  ^ ncTt'-p ) w^ere  ^l»***Yn  as  a rand°m  sample  of  iid 

random  variables  whose  pdf  is  Poisson  with  mean  ?(t-q).  Hence  by 
the  weak  law  of  large  numbers 
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n 

£ Y. 
1-1  2 
n 


Likewise, 

n2  (R-l) 
R(R+l)(R+2) 


P 

+ EY, 


= c(t-n) 


rR-l1rR  R+l  R+2^-1  P , Nr  , , i 


-3 


= (?(t-n))  2. 


Moreover,  {n2(R-l  )/R(R+l ) (R+2)  } 1+<SI  < {n2R  2}1+<SI 


[R>2]  ” iV  J "[R>2] 


for  5 > 0 and  for  every  0 < e < 1, 


E[n2+2V(2+26)I 


[R>2] 

2+26R-(2+26) 


] 


E^n  R ^I[2<R<n?(t-ri)(l-e)]+  1 [R>n£( t-q) ( 1-e) ] ^ 

< n2+2V(2+26)p(R<n?(t-n)(l-e))  + {C( t-q) ( 1-e) }"(2+26) 

< n2+262"(2+2<S)p(|R-n?(t-T1)|>en?(t-T1)) 

+ {c(t-q)(l-e)}_(2+26).  (3.2.13) 

Using  Markov's  inequality 
P( |R-nc(t-n) |>en£(t-n)) 

< E|R-n?(t-q)|8+4<S(en?(t-n))_(8+46)<  Kn"(4+26),  (3.2.14) 
where  in  (3.2.14),  we  have  made  use  of  the  following  lemma. 

Lemma  3.2.1  (See  Serfling  (2.22))  If  Y^.^Y  are  iid 

iv  n 

with  E I Y | <»  for  some  v > 0 then  e(  £ (Y.  - EY.))V  < Kn 

i=l  1 

K is  a constant  which  does  not  depend  on  n. 

Hence,  combining  (3.2.13)  and  (3.2.14),  one  gets 


v/2 


where 


2+26  i , 1+6 

sup  n E I (R-l )/R(R+l ) (R+2) j I 
n>l 


[R>2] 


. 2+26  | -(2+26)t 
< sup  n E j R ' I 

n>l 


[R>2] 
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< SUP  [n^V(2+2«K„-<4+2»  + U(t-n)U-s)r(2+2S>]  - 0(1), 

n>l 

which  implies  that  [n2 (R-l )/R(R+l ) (R+2) ] I r , is  uniformly  inte- 
grable  in  n.  This  together  with  a.s.  convergence,  implies  that 

'"2  (3.2.15) 


E(n2(R-l)/R(R+l)(R+2))l[R>2]  + (?(t-q))' 


as  n -h». 


Hence,  using  (3.2.11),  (3.2.15)  and  the  first  part  of  this 
theorem,  one  gets 

At 

A 2 

n2E(q-q)  + 5 as  n « 
which  completes  the  proof  of  (ii).  □ 

It  follows  as  a consequence  of  this  theorem  that  asymptoti- 

At 

~ * 
cally  q achieves  50%  risk  reduction  than  q.  Table  3.2.1,  on  the 

At 

next  page,  shows  the  percentage  risk  improvement  of  q over  q for 
certain  combinations  of  t when  q=0  and  5=1. 

At 

It  is  also  possible  to  obtain  the  exact  bias  of  q and  q. 


Simple  calculations  yield 


E(q-q)  - (n?)  * [ 1~{ l+n£(t-q) } exp(-n£(t-q)) ] . 


(3.2.16) 


Also, 


E(q-q)  = E(q-q)  - e[r  *(t-q)  I ~ ] 


- E(q-q)  - e[r  1/jj(t-x)R(t-x)K  X(t-q)  Kdx] 


,R-1 „ . , -R 


= E(q-q)  - (t-q)E[(R+l)-1[R>1]]. 


(3.2.17) 


* ”1  * “"1—1 
Thus,  nE(q-q)  ->-5  as  n » and  nE(q-q)  ->-5  -5  = 0 as  n ®. 
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TABLE  3.2.1.  MSE's  OF  n and  r\  AND  PERCENTAGE  RISK 
IMPROVEMENT  (PRI)  OF  n OVER  n 


n = 5 n = 10 


t 

n2MSE(n) 

/\ 

n2MSE(ri) 

PRI 

n2MSE(n) 

n2MSE(n) 

0.2 

.5285 

.5184 

1.91 

1.1880 

1.1098 

0.4 

1.1880 

1.0997 

7.43 

1.8168 

1.4586 

0.6 

1.6017 

1.3244 

17.31 

1.9653 

1.3126 

0.8 

1.8168 

1.2595 

30.68 

1.9940 

1.1600 

1.0 

1.9191 

1.0474 

45.42 

1.9990 

1.0830 

1.5 

1.9906 

.9070 

54.44 

2.0000 

1.0788 

1.8 

1.9975 

.7888 

60.54 

2.0000 

1.0781 

n = 15 

n = 20 

t 

n2MSE(n) 

A 

n2MSE(n) 

PRI 

n2MSE(ri) 

n2MSE(n) 

0.2 

1.6017 

1.3954 

12.88 

1.8168 

1.4644 

0.4 

1.9653 

1.3544 

31.09 

1.9940 

1.2322 

0.6 

1.9975 

1.1672 

41.57 

1.9998 

1.1883 

0.8 

1.9998 

1.1043 

44.78 

2.0000 

1.1009 

1.0 

2.0000 

1.0909 

45.45 

2.0000 

1.0992 

1.5 

2.0000 

1.0908 

45.46 

2.0000 

1.0992 

1.8 

2.0000 

1.0908 

45.46 

2.0000 

1.0992 

PRI  = 

MSECS)  -_MSE(S)  x 100_ 

MSE(n) 

PRI 

6.58 

19.72 

33.21 

41.83 

45.82 

46.06 

46.10 


PRI 

19.40 

38.20 

44.08 

44.96 

45.04 

45.04 

45.04 
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Hence,  r|  achieves  asymptotically  100%  bias  reduction  than  p,  and, 
in  (3.2.17),  we  have  used  the  fact  that 

“1  _ 1 p 

n(R+l ) I[R>1]  * ((t-p)?)  + as  n 

and 

sup  < sup  n2+25E(R-<2+2«I[E>1]) 

. , 2+26v  -(3+26)  r , W1  . \-(2+26)  N 

< sup  [n  Kn  + ( ?( t-n) ( 1-e) J ) = 0(1) 

n>  1 

which  implies  that  n(R+l)  ^ is  uniformly  integrable  in  n. 

A A 

Next  we  investigate  the  asymptotic  distributions  of  p,p  and 

a 

?.  Since,  for  all  £ > 0, 

p(n  * x(]j)  = P^x(i)  > *0  = exP  (-nc(t-p)) , 

00 

and  I exp(-n£(t-p) ) < °°,  it  follows  from  the  Borel-Cantelli  Lemma 
n=l 

and  the  definition  of  p in  (3.2.2)  that  p - X^  q 

as  n + “. 

Moreover,  for  0 < x < n(t^-p), 

P(n(X(i)-p)  > x)  = /^n?  exp[-?n(x(1)-p)]dx 

n 

+ exp[-n?(t-p)] 

= e_CX  (3.2.18) 


and 
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p [n(x(  1 )~ ^3  _ nCt^n)]  = exp[-n?(t-p)  ] 


(3.2.19) 


Hence  from  (3.2.18)  and  (3.2.19)  one  gets  n(X(1)  - p) 

converges  (as  n-w)  to  an  exponential  rv  U with  location  parameter 

0 and  failure  rate  £.  So,  asymptotically,  as  n-*-°° 

^ d 

n(p-n)  ->  U (3.2.20) 

The  following  theorem  provides  the  asymptotic  distribution  of 

n(n-n) . 

A 

^ . H -1 

(3.2.21) 


Theorem  3.2.3  n(p-p)  + U - f 1 as  n + ®. 


Proof  Write 


n(p-n)  = n(n-n)  - c 1 i 


[n<x(1)<t]* 


(3.2.22) 


From  the  definition  of  5 in  (3.2.3),  ? + ? as  n -►  =0, 


also  I 


3.  • S • 


[n<x^  <t]  * ^ as  n 00 • The  theorem  now  follows  from 


(3.2.20)  and  (3.2.22).  Q 

Next  we  find  the  asymptotic  distribution  of  £.  It  follows 
from  (3.2.3)  that 


n(n~n) 


-v. 


( t— n) ( t-p) 


[n<t] 


+ ^^[^t]'1)*  (3.2.23) 

Since  R ~ Poisson  (n?(t-p)),  ^n(-(*_n)  " z)  N(0,  -£-)  by  the 

p 

C.L.T.  and  R/n  > s(t-p).  Also,  from  (3.2.20), 

* ~ p 

n(p-p)  - 0 (1),  so  that  p ► p (in  fact, one  can  directly  show 
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A ^ g 

that  n r,).  Thus,  from  (3.2.23), 

^n(£-c)  --■*•  N(0,c(t-n)_1) . 

Now,  using  the  lemma  that  follows,  one  gets 

^“(5  1 “ C *)  N(0,c  3(t-n)_1)  (3.2.24) 

Lemma  3.2.2.  Suppose  that  X is  AN(u,ct2),  with  a -►  0 as  n > ». 

n n n 

Let  g be  a real  valued  function  differentiable  at  x = u,  with 
g (u)  * 0.  Then 

g(X  ) is  AN(g(u),  tg^(u)]2a2). 

11  n' 


We  shall  next  show  that 

(r1  - r1)]2  is  uniformly  integrable  in  n>l, 
so  that  from  (3.2.24)  and  (3.2.25),  one  gets 
E[n(J_1-  C_1  )2 ] + ?"3(t-n)_1. 

In  order  to  prove  (3.2.25),  first  write 


-1, 


(3.2.25) 


(3.2.26) 


= 2 rn(h-h)  n(t-n)  _ -1  „ 

L R R C [p<t] 


a 

33n2rlL4-(h-Ti)4  T in(t-n)  -1i4t 

J R* I[R>1]+  I R C I 1 [R> 1 ] 


-4 


+ C I"  . ,-iM 
1 [n  < t]  I J 

since  Ir"  . . = I. 

[h  < t]  [R  > 1] 

Note  that,  using  the  Schwarz  inequality 


(3.2.27) 
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E[(T,-n)-E'4n4I[R>1]]  < EV2(S-n)8  E V2  (r~8„8I  (R>  l } ) 
where 

E(n-n)8  = /*  n?(x(1)-n)8e"n^x(i)_T1^dx(1)  + (t-n)8e'n?(t'Tl) 

= (n?)'8[/^(t_ri)z8e“zdz  + (nc(t-n))  e_n5(t"I,)] 

< (n?)-8  r [7 ] 

”8  8 

and  E(R  n ijr>1j)  = 0(1)  using  arguments  similar  to  (3.2.13)  and 
(3.2.14) .Hence 

n2E[(n-n)4R  4n4I [R>1 ^ ] = 0(n2  • n“4)  = 0(n"2) 
which  shows  that 

sup  E(n8(n-n)2R~2l[R>i])2  < (3.2.28) 

Moreover , 

E[{.n,(t-n)  _ -iii,.  l 

U R 4 1 [R  > 1]J 

- e[(e  - nc(t-n))V4{'4i[E  „ u] 

< c 4E  !/2(R-nC(t-n))8  ) n].  (3.2.29) 

It  is  easy  to  check  using  Lemma  3.2.1,  that 

E(R-n?(t-n))8  = 0(n4)  while  E[R~8IrD  < 

LK  > 1 J J 

P(R<n?(t-p)(l-e))+(nc(t-n)(l-e))-8 

< P( |R-nc(t-n) | > nec(t-n))  + (n?( t~n) ( 1-e) )-8  = 0(n“8). 
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Hence,  from  (3.2.29),  it  follows  that 


Also, 


- nV4  P[n  > t]  - „25-4e-nC(t-,’)  - o(l) 


(3.2.31) 


Now,  it  follows  from  (3.2.27) , (3.2.28) , (3.2.30)  and  (3.2.31)  that 


n>l 

Note  that  (3.2.25)  is  an  immediate  consequence  of  (3.2.32). 

3.3  Estimation  in  the  Two  Sample  Case 

Suppose  that  two  independent  sets  of  items  are  put  to  test, 
where  the  first  set  contains  n^  elements,  and  the  second  set 
contains  n2  elements.  The  lifetimes  of  the  items  in  the  ith  set 
are  assumed  to  be  iid  with  common  pdf 


Once  again,  the  duration  of  the  experiment  is  fixed,  and  the 
censoring  times  for  the  two  sets  are  denoted  by  t^  and  t2«  We 
assume  that  < t^(i=l,2).  Also,  for  definiteness  let  t^  < t2» 

An  item  which  fails  before  the  termination  time  is  either  replaced 
by  another  item,  or  is  repaired  and  tested  again.  The  replacement 
items  from  set  i have  an  exponential  distribution  with  the  same 
failure  rate  but  with  location  parameter  0(i=l,2).  We  denote 
by  Ra  the  number  of  failures  before  time  t±  for  the  set  i(i=l,2). 
Then  R^s  are  independent  with  Ri  ~ Poisson  (ni?i(ti-qi)) , 1=1,2. 


sup  E[n2(£  1 -£  1)4]  < oo. 


(3.2.32) 


(3.3.1) 
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Given  = r^(>0) , the  order  statistics  for  set  i are  denoted 
^ X(il)  X(ir ■ ) * 2) • First  consider  the  case  when 

71 1 * ^2  * ^ 1 anc*  ^2  are  a H distinct  and  unknown.  In  this  case,  the 
MLEs  of  rij; ' s and  £^'s  are  given  respectively  by 


= X<“)I[x(11)  < tJ  + V[x(n)  > t±] 


and 


?i  - {Rjy(ni(ti-Tl))}  I|.~  j i=l,2.  Using  a straightforward 
extension  of  the  results  of  Section  3.2,  it  follows 


that  p = p.  - (n,£.) 


-1 


l ~ ^ <t.]  achieve  asymptotically 

100%  bias  reduction  and  50%  MSE  reduction  than  (i=l,2). 

Also  the  scale  parameter, 


h ~AN ),  (i-1,2) 


'-1  -1 


and  njL(ci  - ?i  )2,  is  uniformily  integrable  as  n.  -►<»  which  implies 


~ ?•  )2]  ? 3(t  -n  ) * and 

11  1 111 

Et/ni(ci  “ h 0 as  (i-1,2). 

Next  we  consider  the  case  when  Pj  = P2  = h,  but  ^ and  ?2  are 
not  necessarily  equal.  First  consider  the  case  when  p,  and  £2 
are  all  unknown.  In  this  set  up,  estimation  of  p in  the  uncensor— 
ed  case  was  considered  by  Ghosh  and  Razmpour  (1984),  and  for  the 
type  II  censored  case  by  Chiou  and  Cohen  (1984). 
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Write  Z = min  (X( ^ ^ ,X(2i) ) • An  examination  of  (2.3.14)  - 
(2.3.17)  of  Chapter  Two  reveals  that  the  MLE  of  p,^  and  ?2  are 
given  respectively  by 

n ~ ZI [n<z<t1  ] + tiI[z>t1]’  ?i  = (Ri/ni(ti-n)} 

The  pdf  of  n is  given  by  (2.3.66)  and  (2.3.67),  where  it  was 
derived  for  known  and  £2>  but  of  course,  remains  unchanged  when 
4^  and  £ £ are  both  unknown.  Hence,  once  again 
f(z)  = a exp(-a(  z-p)  ) , p < z < t^ 

P(Z  = tj)  = exp  (-attj-Ti)), 
where  a = n^  + n2C2» 

Note,  from  above  that  p ► p as  min(n.  ,n„)  > °°  since 

00  co  oo 

E P[|h  - p|  > e]  = E I exp[-a(t  -p)]  < °°.  Next,  to  find  the 
n=l  n1=l  n2=l 

asymptotic  distribution  of  p,  first  let  n = nj  + n2«  Assume  that 

lim  n /n  = X,  0 < X < 1.  (3.3.2) 

n-*» 

The  next  theorem  provides  the  asymptotic  distribution  of  p. 
Theorem  3.3.1  Assume  (3.3.2).  Then  n( p - p)  converges  in  distri- 
bution to  an  exponential  random  variable  with  failure  rate  X?^  + 

(i-x)c2. 

Proof  Note  that  for  every  u in  (0,n(t^-p)), 

P(n(p-p)<u)  = 1-exp (-au/ n)  + l-exp(-(X?1  + (1-X)?2)u),  (3.3.3) 
as  n + ®.  Also 

P(p  = t1)  = exp(-a(  t^-p) ) -►  0 
This  proves  the  theorem.  □ 


as  n + ®. 


(3.3.4) 
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When  the  two  populations  have  common  location  parameter  p,  if 
and  are  known,  the  UMVUE  of  p was  obtained  in  Chapter  Two 
and  is  given  by  n - a-1I[n<z< j . Thus,  when  ^ and  c2  are 
unknown,  we  propose  the  modified  ML  estimator  of  p as 

" ' " ‘ all[n<z<t,l-  (3.3.5) 

A 1 

where  a is  obtained  by  plugging  the  ML  estimators  of  and  ^ for 
and  ?2  in  a* 


Note  5.  = 


Ri 


1 " HjCtj-J)  [n<,'<ti)  " "dV0  ’ (t  -b  h<S<tl) 


for  i=l,2. 


Recall 


a.s , 


n£t.-p)  + and  p -»■  p as  min  (n1,n2)  ->■  =°. 


Also’  z[p<z<tl]  1 since 


00  00 

E E P[|l 


00  00 


•i|‘[n<z<tl]-1l  > d - i i e'a(trn)  < 
* n2  * 1 n , =1  n A=1 


1 2 


Hence  5 + 5 as  min  n °°  for  i = 1,2  and  under  the  assumption 

i-1,2 

(3.3.2) 


*-l 

na 


= fVi 


+ 


V2 


SL  • s • 


+ ( 1 —A) ^2 ) 1 = g Z(say). 


Hence  using  Theorem  3.3.1  n(p  - p)  converges  in  distribution  to  W 
“ g l>  where  W is  exponential  with  failure  rate  g.  Next  we  find 

/V  A 

asymptotic  MSE  s of  p and  p . Direct  calculations  give 
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E[n2 (n-n)2 ] = (2n2/a2)[l-(l+a(t1-n))exp(-a(t1-n))] 

20?!  + (1  -^)?2)"2  = 2g~2  (3.3.6) 

as  n ->■  oo  using  (3.3.2)  and  the  fact  that  a = n^  + We  next 

show  that 

a 

E[n2 (n~n)2 ]-*■  g as  n ^ oo.  (3.3.7) 

a 

Since  we  have  already  shown  that  n(n-ri)  converges  in  distri- 
bution to  W-g-1,  where  W is  exponential  with  failure  rate 
S * , it  remains  only  to  prove  that 

a 

{n2(p-n)2}  is  uniformly  integrable  (u.i)  in  n > 1.  (3.3.8) 

In  order  to  prove  (3.3.8),  first  use  the  inequality 

n2(n-n)2  < 2[n2(n-n)2  + n2a“2I[T1<z<t  jj.  (3.3.9) 

The  u.i.  property  of  n2(q-q)2  follows  easily  by  showing  that 
E(n4(n-q)4)  = /r)a(n(x-n))4exp[-a(x-n)]dx 


+ n4(t1-q)4exp[-a(t1-n)] 

< n4a  4/“z4exp[-z]dz  + n4( t l -q)4exp [-a( t -n) ] 

= n4a  T(3)  + n4(tj-n)4exp[-a(tj-n) ] 

=0(1)-  (3.3.10) 

Thus,  we  need  only  prove 

Theorem  3.3.2  n2a  ^ [ ti<z< t ] u'^*  -*-n  n* 

Proof  The  proof  follows  by  showing  that 

sup  E[n3a-3I[n<z<ti]]<  ..  (3.3.11) 

But , 

n3E[a  2Ir  1 

L [n<Z<t  ]J 


- - «2S2r3CiIlli>ll-«tRi_o>R2>11)xtn<I<t 
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< I,3[(nlC1)  I[EI>1]  + (-n2h)  3l[E  >1)1 


- "3E[£2i.1<tr'')3E:3i[R.>1I] 


< n3 


(3.3.12) 


Arguments  similar  to  (3.2.13)  will  now  show  that  the  right  hand 
side  of  (3.3.12)  is  0(1).  Q 

Simple  calculations  also  show  that  E(n(p-p))  -►  g . On  the 

a 

other  hand,  since  n2(p-p)2  is  uniformly  integrable  (u.i.) 

a 

A 

then  n(p-p)  is  also  u.i.,  which  together  with  the  fact 

a 

~ L -1 

that  n(  ti— ri ) — ► W-g  , implies  that 

A 

^ — 1 

En(p-p)  + E(W-g  ) = 0.  Thus,  p achieves  asymptotically  100% 

a 

bias  reduction  than  p. 

Next,  using  arguments  similar  to  the  ones  given  in  Section 

3.2  one  gets 
* ^ 

(Ci“?i)  — ► N(0,ci/(ti~p))  as  min(n1,n2)  « (i=l,2). 

Using  Lemma  3.2.2,  it  follows  now  that 


,*-1  "lx 

(h  'h  > 


-*  K(0,cj3(tt-n)  *)  <1-1, 2). 


Calculations  similiar  to  (3.2.26)— (3.2.32)  will  then  yield 


E [ni  ( 1~C~1  )2  ] -*■  ?i3(ti~p)  1 as  min(ni,n2)  + 00  (i-1,2). 
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Next,  we  consider  the  case  when  ?1  = £2  =£,  but  n1  and  n2  are 
not  necessarily  equal.  In  this  case,  using  (1.1.9)  the  joint  pdf 

of  x(2i)  •••x(2R2)»  Rl  and  R2  is  §iven  bx 

f (x( i i ),..., X(iri),X( 21 ),...X(2r2),ri,r2) 


r-  ri+r2 


( n n X)?  2exp[-ci;2  (t.-n.  )]lr  , . 

i=l  1 1=1  i i 1 Cnl<x(H)<* 


‘"(lr/V 


x I 


r n <x  < i » r. >0,r2>0; 

Ln2^X(21)<,**<X(2r2)<t2J 


(3.3.13) 


f(x(21)>***x(2r9)»°»r2^ 


r2  r2 


n2  ? exp[-^.1n1(t1-ni)]xl[ii2<X(2i)<_ 


•<X(2r2)<t2l’ 


r2>0;  (3.3.14) 


f(x(H),...,X(iri),  rp  0) 


rl  rl 


= nx  ? exp[-c^?=1ni(ti-n.)]i 


Cnl<X(ll)<...<X(lr1)<tl] 


r x>0;  (3.3.15) 

f(0,0)  = exp  [^^^.(t.-n.)].  (3.3.16) 

From  (3.3. 13)— (3.3. 16) , it  follows  that  writing  R = + R2, 

(X(H)»  x(2i) » R)  is  sufficient  for  (n^r^.e)  and  the  MLEs  of 
91,92  and  C are  given  respectively  by 

i (il)  [9.<X(il)<t.]  ItX(il)>ti] 


and 
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C 


R/i^.lni<ti-ni)}l[R>l] 


(3.3.17) 


Since  X(il)  (i=l,2)  has  pdf 

f(x(U))  - n1?exp[-„l!(x(.1)-n.)]  n1<x(.1)<t. 

(3.3.18) 

f(ti)  = exp[-n1c(ti-ni)] 

then,  arguing  as  in  previous  cases  ) converges  in 

distribution  to  an  exponential  random  variable  with  failure  rate  £. 
Also,  if  (3.3.2)  holds,  then,  we  write 

/n(?  C)  ^n1(t1-n1)  + n2(t2-n2)  " C^I[R>1  ] 

+ /-  R ^ni^x(n)~ni)  + , 

^VW  + n2(t2-n2)j(n1(t1-X(11))  + n2(t2-X(21))jJ 

+ /=‘CCI[R>l]-0 


= /K( 


R 


nl(trnl)  + n2(t2_T12) 


- c)i 


[R>1  ] 


+ n 


-V2R  ^ni(X(ll)  V + n2(X(21)~n2)^I[R>n 


n n. 


^n  ^1  +n  ^t2-n2^fn  ^1  X(ll))  +n  ^t2~X(21)^ 

(3.3.19) 

Next,  we  give  the  limiting  behavior  of  each  of  the  three 


terms  in  (3.3.19).  We  rewrite  the  first  term  as  follows: 
^n1(t1-n1)+n2(t2-n2)  _C'*I[R>1] 


_ R _ (°1(t1-n1)-hi2(t2-n2))c 

n1+n2  n1+n2 
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nl  + n2 


nl^tl_nP  + n2^t2_n2^ 


[R>1] 


(3.3.19a) 


In  order  to  obtain  the  limiting  distribution  of  the  above  term  we 
make  use  of  the  following  lemma. 

Lemma  3.3.1  If  {x^,  p > 1 } are  independent  random 


variables  with  EX  = 0,EX2 
n n 


a2,  Elx  1 < oo  for  some  6 > 0, 
n’  i ni 


all  n > 1 and  if 
then 

Hence,  let  6=2 


| | 2+6  , 2+6.  , 

Z EX.  =o(s  ) where 
1 1 n 


j=l 


l xj 

]-i  J 


-->•  N(0 , 1 ) . 


n 


As  before  n = n^  + n2« 


s2 

n 


n 

Z a2  , n>  1 , 

j = l J 


Define  X. 

J 


^.-(ti-ni)? 

^j~^t2_T12^ 


j-l,2,...,n^ 
j=n  +1 , . . . ,n 


where  the  W^'s  are  i.i.d.  Poisson  variables  with  mean  (t^-p^)s  and 

the  Zj's  are  i.i.d.  Poisson  variables  with  mean 

Then 


EX. 

1 


EW. 


j 1,2,... ,n^ , 


ez^  - (t2~n2)c  = 0 


j-n^+1 , . . . 
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CT?  = " 


j-1  »2, . . . ,n^ 


( 1 2 — T1 2 ^ ^ j=n  +l,...,n 


and 


E I X . I 4 = -< 


(tl-T1l  )?  + 3(t1_T11)2?2  j-l,2,...,n 

( c2— n2  ^ ^ + 3^t2_n2^2^2  j=n1+1»***»n 


so  that 


I E I X.  1 4 

j=-C-j 

c ' 


nl  ^ C 1 ~nl  ^?+3nl  ^ C 1 _T11  ^ 2 ?2+n2 ^ C 2_n2 ^ C+3n2 ^ t2_T12 ^ 2 ?2 

Cn i ( 1 1-rl1 ) ? + n2(t2~r|~)  5 )z 


->•  0 


as  min(n^  jn^)  -*■  00 . 


Hence 


Z X. 

j=Li 

s 

n 


n n 

2 (w.-(t  -ni)c)  + z (z  -(t  -n2k) 

j=l  J j=n  +1  J 


’/ln1(t1_Tl1)  + n2(t2~T12)-*C 


R C^Ctj-rij)  + n2(t2-n2))c 
d n n 


(•ni  ( 1 1 — ti  i ) + n2(t2-n2)Js 
72 


--*■  N(0,1) 


n" 


i .e. 


^,R  _ ^WV  + n2(t2-n2)) 


)~  AN{o,(x(t1-n1)+(l-X)(t2-n2))c}. 
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Hence  it  follows  via  Slutsky's  theorem  and  the  fact 

p 

that  *■  1 that  (3.3.19a)  goes  in  distribution  to  a normal 

variable  with  mean  zero  and  variance 
^(xCt^-n^)  + ( l —x ) ( 1 2_ n2 ) ** 

Next  we  note  that  the  second  term  in  (3.3.19),  namely 


n-  V2  1 (ni  (X(n)  np  + n2  (x(2i)~^2))I[R>n 

^n  (tl-nl)+  n“(t2~ri2)^“(t1-X(11))+^-(t2-X(21))](3^3^20) 

= o (1). 

P 

Since,  using  (3.3.2)  one  gets  that 
R ni  R1  n2  R2  P 

n ■ ~ ^ + ~ ^VV  + <l-x)5(t2-n2). 


A1S°  X(u)  I for  i-1,2  and  I(R>1]  5.  1 

2 

as  min  n -►  « and  E n.  (X,  . - n ) is  0 (1). 

i-1,2  i=l  1 Ui;  1 P 

Hence  the  result  in  (3.3.20). 

Finally,  using  the  Borel-Cantelli  lemma, 

/”5<I[K>1]-1)  ~ * 0 

as  min  (n^,n2)  * 00  since 

00  00  CO  00 

s P^I[R>l],t1^  = Z p[R=°]  = 2 E exp[-s(n  (t  -T1.) 

n=l  n-1  n :=1  n2=l  1 L 1 


+ n2(t2-n2)j  < °°. 


(3.2.21) 
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Hence,  combining  (3.3.18)  through  (3.3.21)  one  gets  that 

/n  (£  - c)  -+  n{0,  s(X(t1-n1)  + (l-A)(t2-n2))-1} 

For  fixed  £,  since  the  UMVUE  of  is 

X(il)"(ni?)  ll[ni<X(il)<t.](i=1’2’)«  the  modified  ^ of  \ ^ 
given  by 

ni  = X( i 1 ) " (ni?)  1;t[n.<Xr  n<t.]  (i=1’2)* 

i (ll)  iJ 

In  this  case,  asymptotically  as  n^  ->■  °° 

n^(rl^“Tl^)  = — ► U,  ,an  exponential  random  variable 

with  failure  rate  £,  while 

a 

ni(Vni)  ' nl(x(il)-"i)  - '"Il[n1<x(il)<ti)i  u^‘ 


since  £ = 


n R n R 

ln  n^  n n2J 


1 WV 

i=l  1 


[R>1] 


1, 


n W 


n2 


[R>1] 


p c(^(t1-n1)  + (l-A)(t2-n2)) 

X(trnl)  " < i-X) (t2-n2)  = ? v 

implying  £ 1 £ 5 1. 

Moreover,  for  each  i=l,2,  direct  calculations  give 

A —9 

E(ni(n1~n1))2  — ► 2z  and 

E(ni(Tii~n1))  -*■  ? 1 as  n±+  » 

A 

while,  after  showing  uniform  integrability  of  n^n.-p.)  and  since 
we  already  know  it  converges  in  distribution  to  Ik  - £~i,  one  gets 
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E(n  (n  -n,))2  — ► E(U-C  i)2  = 5 2 and 

A j ^ 

^ C n i ( 11  i — ^ i ) ) "*■  E((U-?)  ) = 0.  Hence,  ru  achieves  asymptoti- 

cally 50%  MSE  reduction  and  100%  bias  reduction  over  q.  . 

Also,  using  Lemmas  3.2.2  one  gets  that 


s 1 1 L i 

/n  (5  - ) - N(0,c"  {X(t1-p1)  + (l-X)(t2-p2)}_1)  (3.3.22) 


-3 


We  shall  next  show  that  [i/n  (5  1 - 5 1 )]2  is  uniformly  inte- 
grable  in  n > 1.  (3.3.23) 

In  order  to  prove  (3.3.23)  first  write 


[•^  (C_1  - r1)]*-  n2[(-Jii 


E wv 


R S )I[R>1J+C  <I[R>1]'1)1' 


-1. 


n, (n.-n. ) 

bR.ii + c- 


r|.1n1(tt-n)  _ ^ 


R 


[R>1] 


-1. 


+ 5 I[R.1]"04 


b,  1 n,-  (t,-",- > 


ovr  1*‘  1 ; 1 "t  if  t-i  n 1 v -I,- 

L R^ [R>1]  X R C J 1 


[R>1  ] 


-4 


+ c O^n-O1*] 


Next,  using  the  Schwarz  inequality 


E( 


Ei-ini(ni-"i) 


R 


I )4 

[R>1]J 


< ^ER  8 1 [ r>  1 ] ^ '2  tE(zi=ini<vT1i))8J 1/2 
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< (ER_8l[R>lj)  V2  C27E{(I,1(^1-n1>)8  + { 


Using  arguments  similar  to  (3.2.13)  and  (3 

-8, 


-8 

ER  I 


[R>1]  = °^n  Also>  using  (3.3.18), 


show  that  E(ni(ni-ni))8  = 0(1), 
Hence 


n2E( 


z!-i"i(VV 


-4  . , 


R [R> 1 ] 


l = °(n2n  + n2n 


Moreover, 


e(- 


■Zi=lni(ti~T1i)  -1 
^-LA-  1 c l)4j 


R 


[R>1] 


- C 4E(i4  [r  - s^=1ni?Cci-ni) ]**)l[R>1  j 


< c'4tE  R_8ltR>i]J  V2  ‘ [sta-^VCV 


Again  ER  = 0(n  ^)  and 


EtR  - = E[R1-n1c(t1-n1 

< E[|R1-n1c(t1-n1)|  + |R2-n  ?(t  -n2)|]8 


<27(E|R1-n1?(t1-n1)|8+E|R2-n2?(t2-Tl2)|8 


n2(h2-n2))8})  ^ 

.2.14)  one  gets 
simple  calculations 


) = 0(n"2).  (3.3.24) 


VJ8]1/2 


) + R2-n2?^t2~T12^8 
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< 27(K1n'|  + K2np 


so  that 


n2E( 


£i-ini(ti-'1i) 

R 


C 1 )4 1 [ R> 1 j < 0(n2n  4 • (n2+n2 ) ) = 0(1)  (3.3.25) 


-4 


Finally 

n2EC~4U[R>ij-l>'*  • n2?'4P[R  - 0] 


2 -4  - n2^(t2_T12> 

=n*-£  e 


(3.3.26) 


Hence,  combining  (3.3.24)  through  (3.3.26),  one  gets  that 


sup  E [ n2 ( £ 1)4]  < oo. 

n>l 


(3.3.27) 


Since,  now  (3.3.23)  is  an  immediate  consequence  of  (3.3.27)  it 
follows  that 

E /n  (?  1 - ?_1)  ->■  0 and 

E[  /n  (?  1 - c-1)]2  -*•  c"3{x(t1-n1)  + (l-X)(t2-n2)}_1  as  n =o. 

Also  if  at  least  one  q^  (i=l,2)  is  known  the  same  results  can 
be  obtained  after  minor  modif icatoins  to  the  proofs  given  here. 

Finally,  we  consider  the  case  when  q^  = n2  = h and  ^ = s2  = 
?•  In  this  case,  the  MLEs  of  q and  £ are  given  respectively 

by  n = ZI[q<Z<tl]  + tlI[Z>t1]  and  ? = {R/^=ini(ti-n)}I[R>i].  We 

a 

can  show  that  n(q-q)  converges  in  distribution  to  an  exponential 
rv  with  failure  rate  £ while 
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^(0»C  {^(t^-p)  + ( 1-A) ( t ^ — ti ) } ).  Also,  by  proving 

the  necessary  uniform  integrability  results,  one  can  show 
that  E[n(n-n)]  -*■  ? ^EtnCp-p)]2  -»■  2 £_2 

and  E[n(l~l-Z~1)2]  - if^A^-p)  + (l-AK^-p)"1} . Also 

a 

a ^ <\  I 

defining  p - p - (n?)  I[n<z<t  j,  it  follows 

^ A 

A A 

r A — 2 a 

that  E[n(p-p)]2  ■+•  £ and  E[n(p— p)]  ->  0.  Thus,  p achieves 
asymptotically  50%  MSE  reduction  and  100%  bias  reduction  than  p. 
Also  if  P or  ? is  known,  all  results  relating  to  the  parameters  of 
interest  still  hold.  We  omit  all  proofs  because  of  their  similar- 
ity to  the  ones  given  earlier. 


CHAPTER  FOUR 


GENERALIZED  LIKELIHOOD  RATIO  TESTS  FOR  THE  WITH  REPLACEMENT  CASE 
4. 1 Introduction 

Suppose  there  are  k independent  location  and  scale  parameter 
exponentials  and  we  are  interested  in  testing  different  hypotheses 
regarding  the  equality  of  the  location  and/or  the  equality  of  the 
scale  parameters  when  sampling  is  done  with  replacement  within 
each  group.  To  be  specific,  suppose  the  experiment  consists  of 
putting  n^,  n2,...,n^  items  to  test  independently,  as  explained  in 
Section  1.1.  Then,  the  likelihood  function  of  all  observations  is 
given  by  (1.1.9)  namely. 


L(2’£)  = i§s^(ni?i)  iexP[_ni?i(ti"T1i)]I[n. 


i<x(il)<...<x(iri)<ti] 


} 


x n_{exp[-n  ? (t  -n .)]}• 


ieS 


J J J J 


The  following  testing  problems  are  considered. 

(i)  ...  = against  H not  all  ^'s  are  equal, 
when  rij,...,q^  are  known; 

(ii)  HQ2:  ...  =?  against  H : not  all  ^ ' s are  equal, 

when  q^  = = • • • =hjc  = q (say),  but  q is  unknown; 

(Hi)  ^ = ...  = 5 against  H^ : not  all  ^'s  are  equal; 

(iv)  Hq4:  = = \ against  H^:  not  all  q^'s  are  equal, 

when  C are  known; 

(v)  Hq5:  q^  = ...  = qk  against  H^ : not  all  qi's  are  equal. 
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when  = ...  = = £ (say),  but  £ is  unknown; 

(yi)  Hg^:  n j = •••  = against  : not  all  r^'s  are  equal; 

(vii)  Hq^:  ti^  = ...  = and  ^ = ...  = ^ against  : not 

all  r^'s  and/or  not  all  ?i's  are  equal. 

The  testing  problem  (i),  (ii),  and  (iii)  are  considered  in 
Section  4.2.  The  generalized  likelihood  ratio  test  ( GLRT ) crite- 
rion A is  computed,  and  the  asymptotic  distribution  of  -21ogA  is 
given  for  both  the  null  and  local  alternatives.  In  Section  4.3, 
the  testing  problems  (iv),  (v)  and  (vi)  are  considered.  In  this 
section,  the  GLRT  criterion  A is  computed,  and  the  null  distribu- 
tion for  - 21ogA  is  derived.  The  testing  problem  (vii)  is  consid- 
ered in  Section  4.4. 

Explicit  computation  of  even  the  asymptotic  null  distribution 
21ogA  becomes  quite  formidable  in  this  case,  but  some  conser- 
vative test  procedure  is  recommended. 

4.2  Testing  The  Equality  of  Failure  Rates 

We  shall  not  make  a notational  distinction  between  the  rv  A 
or  its  value.  Before  carrying  out  the  actual  tests,  certain 

preliminary  facts  are  needed.  Note  that  the  likelihood  ratio  is 
k 

defined  on  2 distinct  regions  according  to  all  possible  (k-tuple) 
combinations  of  r = (r^,...,r^)  depending  on  whether  r^  is  greater 
than  or  equal  to  zero.  Let 

Aj  = of  the  equal  zero},  j=0,l,...,k. 

Hence,  for  each  j,  A.  contains  (^)  elements.  Write  A. 

-1  J J 


(4.2.1) 
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<J> 


u where  (b  ) constitutes  a partition  by 

-i  1 Jl  j(R) 


elements  of  A..  Then 

(<) 


2l0gX  ■ h-o  Ew  (-nogx)i  r 

~ J * 


(4.2.2) 


Note  that  for  j > 1, 


P[(-21ogA)I 


[ReV 


* o] 


< P(at  least  one  R.=0)  < ZR=1P(R.=0)  = ZR=1exp[-n.  q(t.-ri)  ] 


+ 0 as  min  n.  -»■  «. 
l<i<k  1 


(4.2.3) 


Also,  P(R  e Bq  ) + 1 as  min  n.  > ®.  Hence, 

l<i<k  1 

-21ogA  = (-21ogX)I[R  + op(l),  (4.2.4) 

where  by  op(l),  we  mean  a random  variable  which  converges  in 
probability  to  zero  as  min(n^ , . . . ,nR)  <*>. 

Next  we  address  the  problem  of  testing  HQ1.  From  (1.1.9)  it 
follows  that  for  R e BQ1,  MLE  of  q is  q = R^C.  where  C.  = 
ni(q-q),  i = 1, . . . ,k.  Also,  under  HQ,  MLE  of  the  common  failure 
rate  C is  ; = R/C,  where  R = T^=l\  and  C = Z^=1  q.  Now,  for  R e 
®01»  t^le  test  criterion  X is  given  by 

X ’ (RE/lll  C^/CR).  (4.2.5) 


Note  that  from  the  central  limit  theorem, 

(q-  ciq)/(qq)1/2  -+  n(o,i)  as  ni  -►  » (4.2.6) 

which  implies  that  (R±-  Ciq)/(Ciq)1/2  = 0 (1)  and 
q/(qq)  — ► 1 as  q •+■ 
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In  order  to  find  the  limiting  distribution  of  -21ogA,  we  make 
the  following  assumption. 

lim  ni/n  = Ai,  0<A.<1  and  z£_j  A.  = 1, where  n = zj=1n±.  (4.2.7) 

We  now  prove  the  first  theorem  of  this  section  which  provides 

the  asymptotic  null  distribution  of  (-21ogA)Irri  _ ..  in  view 

£ ^Ol-I 

of  (4.2.4),  -21ogA  has  the  same  limiting  distribution  as 
(~21ogA)I[R  e B01]* 

Theorem  4.2.1  If  (4.2.7)  holds , then  as  n -►  »,  under 
H01:  ?1=* * *=?k=?»  ~21ogA-> 

Pro°^  Since  • .=£^=5,  using  a Taylor  expansion,  for  e Bq^, 

one  gets  from  (4.2.5), 

-21ogA  = 2[e£=1  R1log(R./R)  - zjf.1R1log(Ci c/C?)  ] 

= Rilog(Ri/(Cic))  - Rlog(R/(CC))] 

= 2[E^=1  (R.-  C.?  + Cic)log(l+(Ri-C.O(Cic)“1) 

- (R-C5  + Ce)log(l  + (R-C?)(C?)-1)] 

= 2[^i=1(Ri-Ci4  + Ci?)  X 


fW  (RrCi?)2 


(Ri-cic)3 


V 


2r2  r2  R.-e.C  3 

* 5 3IC|53(1+* 


} 


- ( R-C C+C ? ) _ („R  c02  + ^R~c^)3 

Cc  2C2?2  3!(C?)3(l+<j, 


t}  (4.2.8) 


where  0<4>±<1  ( i==l  ,2, . . . ,k)  and  0<<J><1 . 

Then,  after  multiplying  term  by  term  in  (4.2.8)  and  simplify- 


ing one  gets  that 
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-21ogXI[&£Boi]  = Z^  C(Rj-CJC)/(Cjc)  1/2  )2  ~ C(R-CC)/(CC)  ^ )2 

- I ((R.-C .C)/(C  r)  l/2  )3  (C.?)_1/2 
j=l  J J J J 

k ((R.-C  ?)/(C.C)  1/2  )3  (C.O~  1/2 

+ Z 3 — j J - J 

R -C  £ 

j=1  3(1  + * (-j— V)  (C  ?)_1/2)3 

J (C.O'*  3 

k ( (r.-c  o/(c  .0 1/2  )4(c.o_1 

+ 1 J J i- 1 J 

J 3(1  + 4r)  (c  o ;2)3 

J (C.O  72  3 

+ (r-Cc)/  /c?)3  (Cc)-1/2 


f(R-CQ/(CQ  1/2  ]3  (CO  1/2 

3(1  + ♦(■R~cSi  )(cO~1/2)3 

(CO  '2 


((R-CQ/CCQ1^  (CQ1 
3(1  + <()(-^_)(cO"1/2)3 

(co  2 


x I 


[S£Boi]' 


(4.2.9) 


Next,  using  (4.2.6)  and  (4.2.4)  and  the  independence  of 
groups,  one  gets  that 


R-Cg 

/CC 


k 

Z 

i=l 


R . -C . c 

J L. 

<C. C)V2 


(c  /c) 


X/2 
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T k x (t  -n. ) V2 
^ i ) z 


i=l 


(4.2.10) 


^YW 


where  Z is  distributed  as  a normal  variate  with  mean  zero  and 
variance  one.  Hence 

(R-CC)(CC)“  l,2  = 0p ( 1 ) . (4.2.11) 

Next,  using  (4.2.3),  (4.2.6),  and  (4.2.11),  it  follows  from 
(4.2.9)  that 


(4.2.12) 


= { I (R^C  C)2(C  O - (R-C5)2(CC)  ,+o  (1) 

i=l  1 1 B01J  p 

Hence,  for  proving  the  theorem,  it  suffices  to  show  that 

Q -(zJ-iOtfCtO’CCicr1  - (R-cc)2(cS)-i}i[R£Boij^ 


under  Hq^. 


(4.2.13) 


To  prove  (4.2.13),  write  Q = (Y'AY)  Irp  _ R ,,  where  Y = 

~ ~~  US  e Y J ~ 

(Ylf...,Yk)-  with  Yj  = (Rj-Cjc)/(Cj5)  V2 ( j=l , . . . ,k) 
and  Ar  h~  SiXl*  ~i  = C(c1/o1/2,...,(ck/c)1/2). 

Note  that  as  n in  view  of  (4.2.7),  A,-*-  I - d,dr,  where 

~1  ~k  ~1  ~1 

dr  ■ 

Also,  using  the  multivariate  central  limit  theorem,  under  Hm, 


X - \(2.Xk)- 


In  what  follows  we  make  use  of  the  following  lemma: 

Lemma  4.2.1  Let  X = (X^  , . . . .X^)"  be  N^u,^),  1^.  the  identity 

matrix,  and  let  Ckxk  be  a symmetric  matrix.  Then  the  quadratic 
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form  X'CX  has  a (possibly  noncentral)  chi-squared  distribution  if 
and  only  if  C is  idempotent,  that  is  C2  = C,  in  which  case  the 
degrees  of  freedom  is  rank  (C)  = trace  (C)  and  the  noncentrality 
parameter  is  u'Cu'. 


Now’  Ik”  ~1~1  iS  syTnmetric>  idempotent  with  rank  ( 1^-  d^d') 


- tr^£k.""  ~1~1^  = k“l«  Hence, using  the  lemma, 

Y'(I,  - d d')Y  h v2  and 
~k  ~1~1  k-1 

since  Y'(a^-  [ 1^  - d^dj])Y  --»■  0 as  n -*•»  it  follows  using  Slutsky's 
that  Y'A,Y  k.  x2_r  Since  I[R  s , t 1 s . - 


1 


one  gets  (4.2.13).  □ 

Next  consider  the  sequence  of  local  alternatives  q = g + 

Aini  (i=l ,2, . . . ,k).  We  use  the  Taylor  expansion  for  -21ogX  as 
in  (4.2.8).  First  write  (Ri-C1?)/(Ci?)1/2  = (Ri-Ci?i)/(Ci?)1/2  + 


\ — 1 / 2 


1/2 


ci(q  -cXqcr172  = (q/c)172  (Ri-ciq)(ciq)"i^  + A.q 

-1/2  -1/2 

5 • Since  q = q(q-  q)>  using  the  multivariate 

central  limit  theorem,  it  follows  that  Y = ( (R^q  ?) (q ?)-172 , 
...  ,(Rk~Ck?)(CkC)  l72)  --*■  N(6,I^),  where  6 = (5j , . . . , 6^)"  with 
si  = Ai(  ( ti-hi)/?) 1//2-  Arguing  as  in  the  null  case,  it  follows 
now  that  Q — *■  X^_^(t^),  where  the  noncentrality  parameter 

T>  ■ rfik-i  r>«  - 

- ( /.wv^vwl  * yt  >)v2p. 

i-i  i=l 
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Next  we  consider  testing  HQ2.  In  this  case,  the  MLE  of  n is 

= min  X(il),  and  the  MLE  of  q is  q = R±/ (n±(  t±-n) ) for  g,  e 
1 


Bq1.  Let 


k.  A 

Ci~  and  C = Under  Hq2,  the  MLE  of  the  common 

failure  rate  C is  £ = R/C.  Hence,  from  (1.1.9)  for  R e BQ1 , 


£ 

X = i=l  (Ci/Ri)  1(R/C)R. 


(4.2.14) 


As  in  (4.2.8),  for  £ e ®01* 
-21ogX 


„k  2 2 . rRi-Ci? 


‘ 2Ui=l<E1'Cl£  +C!£>H 


(Ri-CiC)2  (Ri-C.?): 


Ci^ 


2 C^?2 


3C13C3C1+*1^^)3 

V 


-(R-Cc+C?){^r^ 
Next,  write 
(Ri-ci?)(cic)“1 


iRzili  + 

2C2?2 


(R-Ct)3 

A 

3C3?3(i+(jRzC£)3 

C? 


(4.2.15) 


- (Ci/Ci)(Ri-Ci?)(Cic)~  ^2  + nj/2  ( p-Ti)(  q-?)-  i/2^-1/2  .(4.2. 16) 
(where  q = n^(t^-ri)  i =l,2,...k  and  ri  is  unknown) 

* P ^ 

Note  that  r)  -+  n as  n + »,  and  n(n-ri)  converges  to  an 
exponential  random  variable  as  n ■*  Thus,  in  view  of  (4«2«7) 

a p 1 / 2 a p 

Ci/Ci  — *■  1 as  n ■>  » and  n ' (p-p)  --*■  0 as  n * 00.  Hence,  writing 

2i  = ^Ri  ~ qc)(q?)  ^2  (i=l , . . . ,k)  , and  defining  = (R^- 
CiC)(Ci?)~  \ for  (i=l,...k),  it  follows  from  (4.2.16)  and  the 
previous  remarks  that  - VL  -+  0.  Note  that  the  Z^'s  are  not 
independent  since  they  all  share  the  same  p.  However 
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* N(0,1)  for  i-l,2,...k  and  the  W^'s  are  independently  dis- 
tributed. It  follows  using  the  multivariate  central  limit  theorem 
that  W = (W1(...Wk)'  -+  Nk(0,Ik)  under  HQ2. 

Using  Slutskys  theorem  and  the  Cramer-Wold  device,  one  gets 
Z = (Z1,...,Zk)"  --»■  N(0,Ik)  under  Hq2» 

Now  from  (4.2.15) 

C-21ogX>ItgeBoi,  * <*  V^lRcB^]  + opU)  (4.2.17) 

uhere  A2  - and  u,J  - ((Cj  /C)  *4 (0^0)  *4  ) . Note  that 

“ P 

Z’(A  -A„)Z  — ► 0,  where  A = I - d„dl  and 
L L z k.  ~z~  2 


^2  (^i^i  u)  ^ , . . . , Xk(tk~n)  ^)(  z X^(t^-p))  ^2 ancj  ^ as 

i=l 

unknown . 

Arguing  as  in  the  case  of  HQ1,  it  follows  that 

(-21ogX)  I[ReB  , x£_x  under  HQ2 . 

~ 01 

Once  again,  consider  the  sequence  of  local  alternatives 

-Vo 

S + ^n^  > i-l,2,...k.  Using  the  first  line  of  (4.2.16), 

one  gets 

zi  * + a11/2r‘/2(c1-c) 


Vo  ,2  _ \—  V 


= UJO  (c  c ) V2(R  -C  5.)  +C.1/2C  ^2  A.  n ^2 

11  ill  i ii 


L 

— ► 


where 


N(6*,  1) 

6i  = Ai(ti_rl)  /2  /?  /2  . 


for  i 
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Since  the  Z^'s  ate  not  independent,  we  write 


Wi  2^Ci?i^  ^(R^-c^q)  + Ci^2  t,  ^(^-5)  i=l,...k  and 

note  that  V±  N(6*,l)  and  W..-Z,.  -+  0.  Also,  the  W. ' s are 

independent  and  hence  via  the  multivariate  central  limit  theorem 
W - (Wj,...,W^)  — ► N(£  , 1^.)  where  £ = (6^,... 6^)'.  Arguing  as 

before  for  the  given  sequence  of  local  alternatives, 

-21ogA  -►  X^_i (T2^  where  t 2 = 

1/2  (i1(t1-n)/E^iX1(t1-n))  l/2  }2 
Finally,  in  this  section,  we  consider  testing  Hq^.  In  this 
case,  the  MLE  of  q is  q = X(il)  and  for  R e BQ1,  q has  MLE  q = 

A A A 

VCiO’  where  ci0  = ni(ti-rii)’  i = l,...,k.  Under  Hg3:q  = ...  = q 
= ?,  the  MLE  of  the  common  failure  rate  £ is  £ = R/Cq,  where  CQ  = 

^i=l  ^10*  Hence,  for  R e Bq^,  t^ie  criterion  A equals 


X ■ fill  <ci0/R1)Rl}<R/VR. 


(4.2.18) 


Hence,  for  R e Bq^, 

nk 


-21ogA  = 2[SR=1  R.log(R./R)  - ^=1R.log(Ci0/C0O] 


= 2[lR=1  (Ri-Cjoc  + Clo5)log(l+ 


Ri  Ci0C 

/s 

Ci0^ 


) 


R_C  £ 

- (R-c0c  + c0o  log  (1  + -j-2-)]. 


Note  that  since 

(R,-C 


V 


(4.2.19) 


1 i0«)(cio?)"1/2  - <C10/C10)1/2[(R.-C10C)(C10C)  1/2f 


- {(VV^VV"*)  nJ'V'2.  (4.2.20) 


1/2 i 1/2  1/2 
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where  C.q  = iK^-p..)  (i=l k) , ^ -+  n.  and  n±  (J  -t,  ) an 

exponential  random  variable,  using  the  multivariate  central  limit 
theorem,  it  follows  from  (4.2.20)  that  under  HQ, 

«Ri-CioC)(CioO  1^2,*..,(Rk-ck0c)1//2(CkoC)  1//2)" 

->  Nk(0,Ik),  (4.2.21) 

as  n co.  Hence,  (R1-Ci0C)(Ci0c)“1/2  = 0 (1)  and  R1/(Ci(Jc)  --*•  1 
as  n •*  ®.  it  is  now  easy  to  see  from  (4.2.19)  that 

("21ogX)IU  a B01]  = (ri3S)  I[R  e B01]  + V°*  (4‘2*22> 


where  U = (Uj , . . . ,Uk) 'with  U±  = (R.  -Ci0?)(Ci0£)  1/2 , i = l,...,k. 

A3  = ~k_~3~3 ’ ~3  = ^(C10/C0)  /2’*,*,(Ck0/C0)  ^ ) and  C0  = Ei=lCiO 
Arguing  as  in  the  case  of  HQ1,  it  follows  that  under  H( 


03 


(-21ogX)I g B j Also,  since  ni  — ► p as  m ®,  for 

local  alternatives  = C + Aini_  ^2,  one  gets 
-21ogX  X^_j(t3),  where 

t3  * 

- hJ.1A1(tI-n1)  ‘4  (V Wl^VW) 1/2 ) 

and  the  p^'s  are  all  unknown  for  i = l,...,k. 

4.3.  Testing  The  Equality  of  Locations 

First  we  test  HQ4.  Note  that  R e BQ1  <=>  X(11^<  t±  for  all 
i=l,...,k.  The  MLE  of  is  n.  = ^(il)*  w^ile  under  Hq4,  the  MLE 
of  the  common  location  parameter  p is  p = ^njir^  X(n)*  Hence, 
from  (1.1.9),  for  R e Bq^,  the  GLRT  criterion  X is  given  by 


X = 


= exp[-EJ=1  ni?i  (p±  -p)]. 


(4.3.1) 
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Thus,  for  R e Bq^, 

-2iogx  = 2E^=1  n.q  (n.  - n) 

= 2[ Ei=i  ni?i  (n±  - n)  - e^_1  n±q  (n±  -n)].  (4.3.2) 

The  first  theorem  of  this  section  finds  the  asymptotic  null 
distribution  of  -21ogX.  Specifically,  we  prove  the  following 
theorem. 

Theorem  4.3.1  If  (4.2.7)  holds , then  under  Hq^, 

(-21ogX)I[fi  e ,qj ] - 4-2" 

Proof  Suppose  Y^,...,Yk  are  independently  distributed,  Y^  having 
pdf 

f(yi)  = Vi  exp[-ni?i(yi-I1i^I[yi>ni]»  (4.3.3) 

i = l,...,k.  Then,  it  is  easy  to  see  that  under  Hq^, 

(X(H) , • • • ,x(kl))  - (Wj,...,Wk),  (4.3.4) 

where  W^'s  are  independently  distributed  with 

Wi  = YiI[n<Yi<ti]  + tiI[Yi>ti]»  1=1 , • • • ,k.  (4.3.5) 

In  the  above  means  equal  in  distribution. 

Next,  observe  that 

P^W  = P(Y±>ti)  = exp[-njLci(ti-ni)]  + 0 as  n_L  ». 

Hence>  Yi-  W±  -+  0 (as  n±  ■+  a.).  (4.3.6) 

Thus,  from  (4.3.2)  and  using  Slutsky's  theorem, 

(-21ogA)I^  £ j has  the  same  limiting  distribution  as 
H = ^ ] , where  Y = 

min( Yj , . . . , Yk ) . 

Note  that,  under  Hq^,  =...=p^,  Y is  complete  sufficient  for  q 
and  H is  ancillary,  i.e.  H has  a distribution  which  does  not 


-108- 


depend  on  p.  Hence,  using  Basu's  theorem,  H and  Y are  indepen- 
dently distributed.  Also,  n^^^(Y^-p)  ~ under  Hq,  while 

2(^=1  n^?^)(Y-ri)  ~ under  Hq.  Accordingly, 

-21ogX  ~ X^-2  under  Hq.  Q 

Remark  1 In  the  uncensored  case,  -21ogX  is  distributed  exactly  as 
x2k-2  ^see  for  examPle  Hogg  (1956)). 

Next  we  consider  testing  HQ5.  In  this  case,  the  MLE  of  pi  is 

a 

= ^(ii)  and  the  MLE  of  the  common  scale  parameter  5 is  5 = 
H/^i=i  n^(t^— p^).  Under  Hq^,  the  MLE  of  the  common  location 
parameter  p is  p = ^Djii^  X(il)  and  the  MLE  of  ? is  ? = R^i=l 

a 

ni^ti-T1)’  Then  for  £ e B01’  t^ie  ^LRT  criterion  X is 

* = (?/?)R  = {j:i=1ni(ti-hi)/^=1ni(ti-S)}R.  (4.3.7) 


Accordingly,  for  R e B 


01: 


-21ogX  - -2Rlog  [l  - h-_l"i<nl  j 


(4.3.8) 


Using  the  inequality  log(l-x)<-x  for  0<x<l,  it  follows  from 
(4.3.8)  that 
<-21ogX)Iu  E 


^R/^i=lni(ti-P))}{2EJ=1ni(Pi-P)}l 


[ReB0i]* 


(4.3.9) 


We  have  proved  already  in  connection  with  testing  Hq^  that 
2TR_i  n^(p^-p)  -+  5 ^x2k-2  unc*er  H0*  Moreover,  under 
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A p 

H0  * 9 — * h and  R/{2^_^n^(t^-n)}  — *■  £.  Thus,  one  gets 

right  hand  side  of  (4.3.9)  x\k_r  (4.3.10) 

Next  using  the  inequality  log  (1-x)  > - x - —*_x)  for  0<x<l,  it 
follows  from  (4.3.8)  that 
(-21ogA)I[s  e B()l] 


~ 01 


(4.3.11) 


We  have  already  seen  that  the  first  term  in  the  right  hand  side  of 
(4.3.11)  converges  in  distribution  to  X?,  9 under  Hn.  Since 

ni(ti-n)  -■*•  c,  n^(q  — n) }2 1 e Bq  ] converges  in 

distribution  to  [c_1/2  x|k_2 ]2  under  H0  andh  T1  as  n -*■  «,  it 
follows  that  the  second  term  in  the  right  hand  side  of  (4.3.11) 
converges  in  probability  to  zero.  Thus,  from  (4.3.9)  - (4.3.11) 
it  follows  that  under  (4.2.7), 

(-21ogX)I[R  £ BqiJ  K x2k_2  as  n , 

Finally,  we  consider  testing  HQ6.  For  R e BQ1,  note  that  the 
MLE  of  iq  is  T1±  = x(i!)»  while  the  MLE  of  q is  q = ^/(n^t.- 

q». 

Under  Hq^,  the  MLE  of  the  common  location  parameter  p is  q 

= l^i<k  X( i 1 ) ’ while  the  MLE  of  is  q = Ri/(ni(ti-n)).  Now 
from  (1.1.9),  it  follows  that  for  R e BQ1  the  GLRT  criterion  is 
given  by 
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£x  «■ 

x = i!i {(ti-ni)/(ti-n)}  i{(t1-J)/(t1-n)}  i.  (4.3.12) 

Note  that  under  HQ6,  since  PCt^  > x J R±  = r.>  0)  = 

{(t±-  1 for  n < x±  < q,  it  follows  that  conditional 

on  R±  = qCi-l,...^),  under  HQ6 , V±  = {(q-  hi)/(  ti-n)}Ri  are  iid 

uniform  (0,1).  Also,  P(p>z|&=  r,  r.  > 0,  i=l,...,k) 
k , 

i21p(h  >2^=  q(>0))  = ij1  {(ti~z)/(ti-n)}  1 under  HQ.  Thus, 
conditional  on  n=  q > 0 l<i<k, 

v = i^n^i"  h)}  i ~ uniform  (0,1).  Next,  observe  that 

conditional  on  R e BQ1,  n is  complete  sufficient  for  n,  while  from 
(4.3.12)  it  follows  that  X has  a distribution  which  does  not 


depend  on  p under  Hq.  Now,  under  Hq^ , conditional  on  R e Bqj  , 

Ei=l^_21ogVi^  ~ X§k  and  ~21og  V ~ x^*  Consequently,  conditional 

°n  ~ £ B01’  ~21°gA  ~*2k-2'  Moreover,  I,  1 -*  1 as  n + ., 

01 1 

and  this  implies  that  (-21ogX)  x~,  0 under  Hn,.. 

Ik- 1 Uo 

^ ^ Testing  For  Location  and  Scale  Parameters 

In  this  section,  we  test  Hq^.  Note  that  for  R e Boi  ’ t*ie  MLE 

A 


Of  Pi  is  p±  - x(i!),  while  the  MLE  of  q is  q = R±/ (n.(  t.-q ) ) . 
Under  HQ , for  R e BQ1  the  MLE  of  the  common  location  parameter  p 

A 

is  P l^i5kX(il)’  the  MLE  of  the  common  scale  parameter  5 

is  £ = R/(Zi=i  q(q-p)).  Hence,  for  R e BQ1,  from  (1.1.9),  the 
GLRT  criterion  X is  given  by 


1 ■ ?'<iSi ‘O 


* R. 


(4.4.1) 


Hence,  for  R e Bq^, 

-21ogX  = 2(E^=1  R.logq  - Rlogc) 

" 2tEi=l  Ril°g(q/c)  - Rlog(5/c)]. 


(4.4.2) 
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Write  C^q  n^(t^  h^)  and  - n^(t^-  h)  as  in  Section 

Hence,  for  R e BQ1,  it  follows  from  (4.4.2)  that 
-21ogX 


[Ei-i<Rr  h5  + v>iog(i+ 

ci= 


4.2. 


-(R-  65  +C?)log  (l  + -4-^)] 

C? 


n. (n.-  n) 

R.log  (1-  1 1 . ) , 

nfCtf-1!) 


(4.4.3) 


* k 

where  C = C^.  Now,  combine  the  arguments  used  for  testing 


as  well  as  Hq^.  This  leads  to 

<'2l0gi)I[R  * B01]  - <V  Vhfl  £ B01]  + V°' 

(4.4.4) 

1 -►  <*>,  where 

Q1  = Zi=l  (Ri-Cc)2(Ci?)“1  - (R-CC)2(C?)_1; 

(4.4.5) 

^2  =Ei=l  (R1/{ni(ti-n)>)  (2ni(ni-  p)). 

(4.4.6) 

Under  Hq7,  conditional  on  R e Bq^  , -->■  • Also,  since 

Ri/(ni(ti-^i))  ? for  a11  i=l , . • • ,k  and  2ER=1  n.^  - 
h)  “*■  C x|(k-l)  conditional  on  g,  e BQ1 , it  follows  that 

^2  x2(k-l)*  Also  I[g  e bq1]  1 as  n > «.  However,  and  Q2 

are  not  independent.  Thus,  under  HQ7 , -21ogX  Y±+  Y2  where  Yj  ~ 

Xk-1  and  ^2  ~ X§(k— 1)’  kut  ar*d  ^2  are  no^  necessarily 
independent.  Hence,  if  we  reject  HQ7  when  -21ogX  > Kj  + K2  where 

K1  = xk-l;a/2  and  K2  = x2(k-l);a/2  where  X^;ct  denotes  the  upper 
100a%  of  x^>  then  it  follows  that  asymptotically  the  proposed  test 
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procedure  has  size  less  than  or  equal  to  a.  As  mentioned  in  the 
introduction,  the  asymptotic  null  distribution  of  -21ogX  is 
difficult  to  obtain  in  this  case. 


CHAPTER  FIVE 


MAXIMUM  LIKELIHOOD  ESTIMATION  FOR  THE  WITHOUT  REPLACEMENT  CASE 
5. 1 Introduction 

In  this  chapter  we  consider  maximum  likelihood  estimation  of 
location  parameters  and  failure  rates  of  two  parameter  exponential 
under  Type  I censoring  when  sampling  is  done  without  replacement. 

The  layout  of  this  chapter  is  as  follows.  Section  5.2 
considers  the  one  sample  problem.  In  this  case,  MLE's  of  the 
location  parameter  and  the  failure  rate  are  given  in  Bain 
(1978).  For  the  location  parameter,  we  have  proposed  a modified 
MLE  which  has  asymptotically  smaller  mean  squared  error  (MSE)  than 
the  MLE.  Indeed,  it  is  shown  that  the  modified  MLE  achieves 
asymptotically  50%  risk  reduction  than  the  MLE.  Asymptotic 
distributions  of  the  MLE's  of  the  location  parameter  and  the 
failure  rate,  as  well  as  asymptotic  distribution  of  the  modified 
MLE  and  the  scale  parameter  are  also  obtained  in  this  section. 

The  two  sample  problem  is  considered  in  Section  5.3.  Several 
cases  are  considered  including  those  where  the  location  and/or  the 
scale  parameters  of  the  two  populations  are  equal.  As  in  the  one 
sample  case,  modified  MLE's  achieve  asymptotically  50%  risk 
reduction  for  estimating  the  location  parameters  than  the 
corresponding  MLE's. 
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5.2  Estimation  In  The  One  Sample  Case 

Suppose  that  n items  are  put  to  test,  and  the  lifetimes  of 
these  items  are  i.i.d.  with  common  pdf 

f (x)  = Cexp[-c(x-n)]l[x>Ti],  (5.2.1) 

where  IA  = 1 if  A happens,  and  IA  = 0 otherwise.  The  duration  of 
the  experiment  is  fixed,  and  is  denoted  by  t.  It  is  assumed  that 
h < t,  since  otherwise  there  are  no  failures.  Also  an  item  which 
fails  before  the  termination  time  is  not  replaced.  Then,  as 
explained  in  Section  1.1,  the  joint  pdf  of  the  ordered  failure 
times  and  R is  given  by  (1.1.7),  namely 

n!  r 

f(*(1),...X(r),r)  = 7n-r)!  ? exp[-?{  J (x(i)-n)+(n-r) ( t-p) } ] 


x I 


[p<x,  ,...<x,  ,<t] 

(1)  (r) 


for  r = l,2,...n  and 


P(R  = 0)  = exp[-n£(t-p)  ] 

It  is  clear  from  (1.1.7)  that  the  MLE's  of  p and  ? are  given 
respectively  by 

11  = x(i)I[p<x(1)<t]  + CI[x(1)>  t]’ 

5 = + (n~R)(t-p)}]l[R>1].  (5.2.2) 

Note  that  using  (1.1.6),  the  conditional  pdf  of  p given 
R = r where  r > 0 is  given  by 
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rc{exp[-c(z-n)]  - exp[-?(t-Ti)]}r-1exp[-c(z-r1)] 
f(z|r)  = — — 

(l  - exp[-?(t-p)])r 

for  n < z < t (5.2.3) 

Also,  for  r=0 

P(Z=t | r=0)  =1.  (5.2.4) 

Then,  since  we  know  from  Section  1.1  that  marginally 
R ~ Bin(n, 1-exp [-£( t-p) ] ) , it  follows  using  (5.2.3)  and  (5.2.4) 

a 

that  p has  marginal  pdf 

f(z)  = n?exp[-n?(z-n)]  if  n < z < t;  (5.2.5) 

P(Z=t)  = exp [-n£( t-p) ] (5.2.5a) 

Hence  p has  the  same  pdf  whether  we  are  sampling  with  or 
without  replacement.  So  that  as  proven  in  Section  3.2 

- l 

n(p-p)  — ► U as  n -*■  «,  (5.2.6) 

where  U has  an  exponential  distribution  with  failure  rate  £ and 

A 2 

E[n2(p-p)2]  + 2£  as  n ->■  ».  (5.2.7) 

Also  p -— — -y  p as  n 
SL  • S • 

Next  we  motivate  the  modified  MLE.  When  £ is  known,  is 

complete  sufficient  for  p,  and  the  UMVUE  of  p is  given  by 
n " (nC)“  ^ [p<X^  ^ )<t] * Substituting  the  estimator  £ for  £ and 

noting  that  I[r)<x^.^<t]  = I[R>1]>  we  ProPose  the  modified  MLE  of  p 
as 


A A A 

n - n - (ns)'  I[R>1] 


“ 11  ~ { Si=i  ^X(i)_T1)  + (n-R)(t-p)}(nR)  *1 


-1. 


[R>1] 


(5.2.8) 
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where  0/0  is  interpreted  as  zero.  Next  writing  X^  , 
uncensored  lifetimes  of  the  n components,  one  gets 

R = Ei=l 1 [X  <t  ] ' Als°’ 


.,X  for  the 
n 


Ei=l^X(i)-T1^  + (n-R)(t_rl) 


Zi=lXiI  [X±<t  ] + 1 Ei=lI[Xi>t]  nT1 

Ei=lYiI[Yi<t-n]  + (t"n)Ei=lI[Yi>t-p]  " n(rrn)  (5.2.9) 

where  Y^  = (X^  - p)'s  are  iid  exponential  with  failure  rate  ?. 
Recall  that  p = l-exp(-£( t-p) ) . Now,  using  the  strong  law  of 
large  numbers,  as  n + »,  one  gets 

‘ + ps'Sio) 


-In 

n Ei=li[Yi>t-n] 


Q.  • S • . v . 

+ P(Y  >t-n)  = l-p; 


(5.2.11) 


R/n  S p.  (5.2.12) 

Since  p p,  and  -----»■  1 as  n + ® it  follows  from 

(5.2.8)  - (5.2.12)  that  as  n ->■  <=», 

£ + C (5.2.13) 

Now  from  (5.2.6),  (5.2.8)  and  (5.2.13),  one  gets 
n(n-n)  = n(p-p)  - C_1I[R>1]  U-c”1.  (5.2.14) 

Next  we  show  that 

E[n2(n  - p)2]  — ► E(U-C_1)2  = ?"2.  (5.2.15) 

In  view  of  (5.2.14)  it  suffices  to  show  that  n2(p  - p)2  is 
uniformly  integrable  (u.i.)  in  n > l.It  was  proven  in  Section  3.2 
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A 

that  n2(n  - n)2  is  u.i.  in  n > 1.  Hence,  to  prove  (5.2.15) 

*_2 

suffices  to  show  that  5 I[r>i]  u,i  in  n * 1 • However, 
(5.2.2), 

? 1 [ R>  1 ] = {Zi=l(X(i)_r|)  + (n-R)(t-h)}  R I|-R>1j 

< ^i=lCX(i)-^)  + (n-R)(t-p)}2R_2I[R>1] 

= {Zi=i(V^[x  -p<t-p]  + 


X R 2I 


[R>1] 


Hence,  for  0 < £ < 1, 


E[r(2+6)i 


[R>1] 


] 


= E^Zi=1YiI[Yi.  <t-n]  + 

] 


2+6 


x R-^I 


[R>1] 


(5 


<E1/2{„-1Ej.1(Y1I[Ii<t.ti]  + <c-n)I(Yj>t_ii])} 


4+26 


(5. 


Vo  r ~l„n 


<E  !|.  lw((«-n).| 


4+26 


V 


x E^fn/R]^25! 


[R>1] 


= El72{n  1(n(t-n))}4+2<S  • E ^2 (n/R)4+26I[R>i ^ (5.2 

Note  that  for  every  e in  (0,1)  and  p = l-exp[-?(t-p) ] 

I 


E[n/R]4+2<S 


<n4+25E(R-<4+2S)(I[UR<nep]+I[R>nEpj)) 


[R>1] 

4+25„,„.  ^ . --(4+26) 


< n P(R<nep)  + (ep) 


(5. 


» it 
from 


.2.16) 


2.17) 


.17a) 


2.18) 
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Next  observe  that  for  every  positive  integer  m, 

P(R<nep)<P( |R-np | >np( 1-e) )<E |R-np | 2m/ (np( 1-e) )2m=0(n  m).  (5.2.19) 
Choose  m > 6 so  that  from  (5.2.18)  and  (5.2.19)  one  gets 


E[(n/R)4+26I[R>1]]  = 0(1). 

Now  from  (5.2.17),  (5.2.17a)  and  (5.2.20), 

e[c'<2+5) 


sup 

n>l 


1 [ R> 1 ] ^ < 


(5.2.20) 


(5.2.21) 


s—2 

which  proves  the  u.i.  of  e[?  I.,,-,,].  The  proof  of  (5.2.15)  is 

LR>1  J 

now  complete.  Note  that  similar  calculations  give 
E[n(r|-ri)]  -*■  0 as  n + <=°. 

* __  I 

We  find  next  the  asymptotic  distribution  of  ? First, 

using  (5.2.2)  and  (5.2.8),  one  gets  VxT  (?  1 - £ *) 

,R 


= SZ  t2:i=l^X(i)-T1)  + (n-R)(t-n)-RC  ]R  I 


“ V?  .n 


n 2 Si=l^YiI[Y.<t-p]  + (t  n)I[Y. >t-n ] ? I[Y.<t-n]^(n/R)I[R>l] 


- /^{n(p-p)}R-1I[R>1]  + ^_1(I[R>1]-1) 


(5.2.22) 


Since , 


n(X( ! ) _T1) 


U, 


y a . s . 


p , and  I 


[R>1] 


a^s^ 


1,  one  gets 


’/n  {n(X^^-n)}R 


-1. 


[R>1] 


0 as  n •+■ 


(5.2.23) 


/—  — 2 P 

and  /n  5 ^[R>1]-^  0 as  n 

Write  W.  = Y±  I[Y;L<t-n]  + ^t-ri')I  [Yi>t-p]_? 

the  W^  's  are  i.i.d.  with  E(wp  = 0 and  V(wp  = 
central  limit  theorem  and  Slutsky's,  it  follows 


— 1 T 

[Yi<t-p].  Since 
p /?2,  using  the 
from  (5.2.22), 
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(5.2.23)  that 

/n({  1-5  ^ ' /n  /2<Ei-lWi)  f 1 [ R>  1 ] ~ 


‘ /n  (V  R I[R>1J  - /nCn(S-n))R_1I 


+ ■'nC'1(I[R>l]'1) 


[R>1] 


^ N( 0, 1/ p£2 ) as  n + »,  (5.2.24) 

where  we  have  written  W = £n  W /n 

n i=l  i 

Using  Lemma  3.2.2,  one  now  concludes  that 
U-O  ^ N(0,p  ?2)  as  n + ®, 

Next  we  show  that 

E[n(£  - ? )2]  + p ^ as  n + «. 

To  prove  (5.2.26),  recall  the  definition  of  W.  after 

l 

(5.2.23).  Then,  from  (5.2.22)  and  using  the  C^-inequality  for 
6>0,  one  gets 

- ^U2+5  < 31+5[e(v“ 

R 


(5.2.25) 


(5.2.26) 


+ (n-n))2+5J)  + E(Vn  5 1(i[r>1]-1))2+5] 


< 31+S[E  V3  [(f)4+25I[R>I]]E  lf2  [„-  V2  Cl^wp]4™ 


+ E1/2[(|)4««I[R>i]]EV2[nV2(-.n)]4+26] 


+ E(/n  U j j-1) )2+2^]  . 


(5.2.27) 


From  (5.2.20)  we  know  that  E (n/R)/t+2lSI 

[R>1  ] 


= 0(1).  Also , 
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since 


E|W^  I < °°  for  s > 0,  using  Lemma  3.2.1  one  gets 

n-<2+S)E(r;,lW.)4+2S  < „-(2+S)k  „2+S  - 0(1)  (5.2.28) 

Furthermore , as  n + «> 

— (2+6)  [ A .->4+26  -(2+6)  c°°  4+26  — z , —(2+6)', 

n E(n(r|-ri))  < n f z e dz  = 0(n  ) (5.2.29) 


v 2+26 


1+6  2+2  6t 


= n"  " P(R=0) 
1+6  2+26 


Also  E(^(I[R>1]-D): 

= n c exp[-n?(t-n) ] + 0 (5.2.30) 

It  follows  that  the  right  hand  side  of  (5.2.27)  is  0(1). 

This  proves  the  uniform  integrability  of  n(?  -5  )2  and  together 

with  (5.2.24)  proves  (5.2.26). 

Remark  1.  If  5 is  known  then  the  modified  MLE  is  the  0MVUE 
estimator.  If  q is  known  then  we  are  again  in  the  regular 
exponential  family  of  densites  and  we  can  use  Fisher's  theorem 
directly  to  obtain  the  asymptotic  behavior  of  the  M.L.E.  Also 
u.i.  results  are  still  true  with  minor  modifications  to  the  proofs 
given  here. 

Remark  2.  The  search  for  uniformly  minimum  variance  unbiased 
estimators  of  parameters  of  interest  becomes  quite  formidable  when 
sampling  is  done  without  replacement,  due  to  the  complexity  of  the 
distribution  of  the  sufficient  statistic  (X(1),  R,  z|=1,  X^). 
Also  the  family  of  distributions  induced  by  these  statistics  is 
possibly  not  complete  due  to  the  fact  that  the  minimal  sufficient 
statistics  is  of  dimension  3,  while  the  parameter  of  interest  has 
dimension  2.  However,  by  using  the  joint  density  of  the  ordered 


-121- 


failure  times  and  R and  arguments  similar  to  those  used  in  Theorem 

2.2.1,  one  can  conclude  that  a function  h(p,s)  is  estimable  only 

00  *1 

if  it  is  of  the  form  E^^u  _.  ( n)  where  Uq(p)  does  not  depend  on 
h • Hence  when  both  p and  £ are  unknown  neither  p nor  admit  an 
unbiased  estimator  based  on  any  function  of  the  ordered  failure 
times  and  R.  Therefore,  we  cannot  have  an  unbiased  estimator  based 
on  R,  either.  Also,  if  £ is  known  only  is 

complete  sufficient  for  p and  using  the  Rao-Blackwell-Lehmann- 
Scheffe  Theorem,  h(x(1))  = X(1)  - c_1n_1[l-I[x  > is  the 


UMVUE  of  p 

If  p is  known,  then  (R,  X^.^)  is  sufficient  for  £. 

Because  we  are  now  in  the  regular  exponential  family,  we  know  that 
the  family  of  densities  induced  by  (R,  z|=1,  X^ ) is  not 
complete.  An  argument  similar  to  the  one  used  when  both 
parameters  are  unknown,  shows  that  £-1  is  not  estimable  in  this 
case  either. 

5.3  Estimation  in  the  Two  Sample  Case 

Suppose  now  that  two  independent  sets  of  items  are  put  to 
test,  where  the  first  set  contains  n^  elements,  and  the  second  set 
contains  n 2 elements.  As  before,  denote  by  Xil,...,Xin_  the 
lifetimes  of  the  n±  items  for  the  ith  set  (i=l , 2) . The  X±j 's  are 
all  assumed  to  be  independent  and  , • . . are  assumed  to  be 

i.i.d.  with  common  pdf 

f(x)  = c.  exp[-c.(x-pi)]  I[x>ti  j (i-1,2);  (5.3.1) 


Again,  the  duration  of  the  experiment  is  fixed,  and  the  censoring 
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times  for  the  two  sets  are  denoted  by  tj  and  t 2«  It  is  assumed 
that  ^ (i=l,2).  Also,  for  definiteness  let  t ^ < t2<  In 

this  case,  since  censoring  is  done  without  replacement,  any  item 
failing  before  the  censoring  time  is  neither  repaired  nor 
replaced.  Denote  by  the  number  of  failures  for  the  it^1  set 
before  time  t±  then  R£  ~ Bin^,  1 - exp [-q( t . -p±) ] ) (i  = 1,2). 
For  R^  = r^(>0)  let  < . ..<X^r  ^ denote  the  ordered  failure 

times  for  the  ith  set.  Generalizing  (1.1.7),  the  joint  pdf  of 
X(il)****,X(i R± ) » Ri  is  given  by 

f^X(H) X(lr1)’rl'x(21)'"-,x(2r2),r2^ 


' ni=lh»1'/(n1-r1)!}511]exp[-E2_lCl{l^1(x(1.)-ni) 


when  r1  > 1,  and  r2  > 1. 


/ . 1 \ ^ , . v ^t . ] 

(il)  (ir  ) iJ 


, (5.3.2) 


f(x 


(11)****  ’ ( lr 2) ,r 1 


,r, ,0) 


rl  r 

‘ tnl!  = l /<n1-r1)!jexp[-?1{E.=1(X(ij)-ni,+(„rri,(trni)} 


when  r^  > 1; 

f(0,X(21),...,x(2r2,r2) 


- n ? (t  -n_)]lr  . x . 

2 2 [ni<X(ll)< <X(lr1)<tl ] 


L 2 r 

- {n2-c2  /(■>2-r2)!}eXp[-nl5l(t1-n1)-c2{l.f1(x(2.)-r,2) 


(5.3.3) 


-123- 


when  r£  > 1; 


f(0,0)  = exp  [-E?=1ni?i(ti-ni)] . 

First,  consider  the  case  when  p^ , anc*  ?2  are 
distinct.  Then,  direct  generalization  of  (5.2.2)  gives 
of  yS  and  ys  as  St  - X(i  , > (l-I , >t , ) + t.I[x 


(il) 


' lV(ilx(i3)-1Ial)lt<vR1>'«))]iu.>1] 


(5.3.5) 
all 

the  MLEs 

(5.3.6) 


for  i = 1,2. 

The  modified  MLEs  of  p^'s  are  given  by 


Sf  - Sf  - (»1t1)'1(l-I[X(11)>t.))  (i-1,2)  (5.3.7) 

A 

* ^ ^ 1 * 

The  properties  of  p,  p,  £ and  £ derived  in  the  one  sample  case 
extend  immediately  to  their  two  sample  analogues. 

Next  we  consider  the  case  when  p^  = P2  = P,  but  ^ and  ^ 
need  not  be  the  same.  In  this  set  up  estimators  of  p are  given  in 
Ghosh  and  Razampour  (1984)  in  the  uncensored  case  and  by  Chiou  and 
Cohen  (1984)  in  the  Type  II  censored  case.  In  this  case  writing 

Z = min(X^ij,  ^(21)^’  t*ie  ^J^‘s  °f  h,  anc^  ?2  are  §aven  respec- 
tively by 


n I[z>t1]^  + tiI[z>t1]; 


(5.3.8) 


R. 


+ (n.-R.Xyn))]!,^, 

for  i = 1,2. 


(5.3.9) 


It  is  easy  to  verify  using  (5.2.5)  and  (5.2.5a)  that  p has  pdf 
f(u)  = a exp[-a(u-p)  ] p < u < tjj 
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P(U=*t1)  = expf-aCt^n)]  (5.3.10) 

where  a = n^  + n2£2.  Also,  from  (5.3.10)  it  is  easy  to  check, 

via  the  Borel-Cantelli  lemma  that  ri —+  p as  min(nj,n2)  °°.  As 

in  Chapter  Three,  to  find  the  asymptotic  distribution  of  p,  first 
let  n = n^  + n2»  Assume  that 

lim  n^n  = X,  0 < X < 1 (5.3.11) 

n-H» 

Also,  Theorem  3.3.1  in  Chapter  Three  asserts  that  if  (5.3.11) 
holds , 


n(p-p)  — ► U, 


(5.3.12) 


where  U is  exponential  with  failure  rate  g = X^  + (1-X)?2,  and 
also  direct  calculations  in  (3.3.6)  give 

**  —9 

E(n2  (p-p)2 ) -►  2g  as  n > ».  (5.3.13) 

Actually  in  (3.3.10)  it  is  shown  that 

n2(h-p)2  is  u.i.  in  n.  (5.3.14) 

To  motivate  the  modified  MLE , note  that  if  and  ?2  are 
known,  then  Z is  complete  sufficient  for  p and  the  UMVUE  of  p is 
given  by 

" - “'‘O-ifwtpl- 

Thus,  when  and  £2  are  unknown,  we  propose  the  modified  ML 
estimator  of  p as 

P = p - a_1 [ 1-1 [z>t  j]  (5.3.15) 

u - . . 1 A A 

where  a is  obtained  by  plugging  the  ML  estimators  and  ?2  for 
and  ?2  an  a*  Under  the  assumption  (5.3.11)  and  writing 

“-1 


na 


= n (- 


niRl 


Sj=1(X(lj)-p)+(n1-R1)(t1-p) 


[R1>1] 
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n2R2 


r2  * . X[R  >1] ^ 

Ej  = JX(2j)_n>(n2_R2)(t2_Tl) 


-1 


where 


h-i^dp-")  * <yV<y"> 


n 


' "I*.1.  CCXij-n]1 


i=l 


ij  i 


+ (trn)I[x  -„>t  -n]l  + Pi'i1 

^ • s • 

and  R^/n^ — ► by  the  SLLN  (1=1,2).  Hence  it  is  easy  to  see 


that  na  1 — ( A^+Cp-X)^ ) 1 - g"1.  Also  (1  - I[z>t  j)  = 
I[ri<Z<t1]  !•  Hence,  from  (5.3.12)  and  (5.3.15),  one  gets 

a t _i 

(5.3.16) 


n(p-n)  ^ U - g 1 , 


In  view  of  the  fact  that  ( 1-1 [z>t  ^ = I[n<z<t  ] , (5.3.14)  and 
the  inequality 


n2(n  -q)2  < 2[n2(q-q)2  + n2a  2Ir  1 

[ n<z<t  x ] J 


(5.3.17) 


for  proving  the  uniform  integrability  of  n2(q-q)2  in  n,  it 

2 

suffices  to  show  that  n2a  I,  , , , is 

[n<z<t1 ] 

uniformly  integrable  in  n.  (5.3.18) 

This  will  then  imply  that 

E[n2(q-q)]2  g as  n -*■  ~.  (5.3.19) 

so  that  comparing  (5.3.13)  and  (5.3.19)  it  follows  that  q achieves 

a 

asymptotically  50%  MSE  reduction  than  q. 


To  prove  (5.3.18),  first  notice  that 


. (5.3.20) 
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Since  (5.3.11)  holds,  from  (5.3.20)  it  follows  that  it  suffices  to 
show 

sup  EU7(2+<S)I[R  < « for  i=l  ,2  (5.3.21) 

to  prove  (5.3.18).  But  the  proof  of  (5.3.21)  is  accomplished  much 
the  same  as  (5.2.17)  - (5.2.20). 

~_1  -'—i 

To  find  the  asymptotic  distribution  of  and  » using 
(5.3.9)  first  write 


’V5!1  - cj1) 


- n^]  + - 1) 


K/Ei ) : 1 1 Vi  j ["1 1/2  Ejii  ( (xij 1 h [Xij « t , 


/n  l?i  h[E  ,!]  0 


3-1  i 


V' 


- (ni  2 /Ri)I[R>>1]  ^(n-n),  i = 1,2. 


(5.3.22) 


In  view  of  (5.3.11),  (5.3.12)  and  the  facts  that 

Ri/ni  * as  n ->■  oo  and  1 as  min(nj,n2)  °°,  one 

gets 


V; 


(ni  2/Ri)I|-R  >i]ni(T1_T1)  0 as  min(n1,n2) 


(5.3.23) 
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and  /n^  (I[R  >^j— 1)  --*•  0 as  n -*■  °°  for  i = 1,2 
Also,  let 


for  i - 1,2.  j = l...n^,  so  that,  ^ . W^n  are  i.i.d.  with 
EWfi  = 0 and  V(W^)  = p^C^  for  i = 1,2. 


It  follows  using  (5.3.22),  the  CLT  and  calculations  similar 
to  (5.2.24)  that  as  min(n^,n2)  °° 


Remark  1 If  at  least  one  failure  rate  is  known  all  convergence 
and  u.i.  results  still  hold  true  with  minor  modifications  to  the 
proofs  given  here.  The  modified  MLE  in  this  situation  would  be 
obtained  by  substituting  the  known  failure  rate  in  the  expression 

a 

for  n,  instead  of  its  MLE. 

Remark  2 If  p is  known,  we  can  invoke  Fisher's  theorem  to 
conclude  asymptotic  normality  of  Vn"7(£^~  ).  The  u.i.  property 

__  -i 

of  (Vn^(c  - £ ;)2  when  p is  known  is  obvious  from  the  previous 


(5.3.24) 


and  via  Lemma  3.2.2,  one  now  concludes  that 


Also,  using  inequalities  similar  to  (5.2.27)  and  (5.2.28), 
one  can  prove  the  uniform  integrability  of  n. )2  as 
min(n^,n2)  00  , for  i = 1,2,  and  conclude  that 


argument.  Also  it  is  then  straightforward  to  see  that 
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E(n(n  p))  -»■  1 while  E(n(p-p))  -*■  0.  Hence  the  modified  MLE 
attains  100%  bias  reduction  over  the  usual  MLE. 

Remark  3.  In  this  situation  it  can  be  easily  seen  using  (5.3.2) 


(5.3.5)  that  Tx  = (Z,  Rx  , S2)(z  = min  (X(U),X(2  ) and 

^i 

Si  = Ej=l  X(ij)  f°r  1 = 1>2)  is  sufficient  for  (p,  ?2). 

Because  the  density  of  T is  very  difficult  to  obtain  and 
may  not  be  complete,  uniformly  minimum  variance  unbiased 
estimators  for  parameters  of  interest  cannot  be  derived.  However 
by  working  with  the  joint  density  of  ordered  failure  times  for 
both  groups,  Rj  and  R2  and  using  arguments  similar  to  those  used 
in  Theorem  2.3.5  one  can  show  that  a function  h(p,  t, ^ , £2)  is 


00  00 


r r 

estimable  only  if  it  has  the  form  Z Z u (n)?  2 where 

r =0  r =0  ri’r2  1 2 

Uq.o^h)  does  not  depend  on  p. 

Hence,  neither  n,  nor  admits  an  unbiased  estimator  based 

on  any  function  of  ordered  failure  times  for  both  groups,  R^  and 

R2*  Therefore  there  cannot  exist  an  unbiased  estimator 

of  p,  5 ^ and  £ * based  on  T, . 

I Z ~1 

If  one  failure  rate  is  known,  say  again  using  this 
argument,  it  can  be  shown  that  there  is  no  unbiased  estimator  for 
conclusion  can  be  made  about  estimating  p. 

If  both  failure  rates  are  known,  then  p is  estimable  and  has 
UMVUE  given  by  h(Z)  = z-a  * [ 1 - j]  where  a = + n252. 

If  p is  known,  one  can  also  show  that  neither  5^  or  5 ^ is 


estimable. 
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Next  we  consider  the  case  when  ^ =5,  but  and  n2  are 

not  necessarily  equal.  In  this  case,  an  examination  of  (5.3.2)  - 
(5.3.5)  reveals  that  X^j)  and  R = + R2  is  minimal 

sufficient  for  ri  j » ti2  and  £.  Maximum  likelihood  estimators  are 
given  respectively  by 


ni  X( i 1 ) ^ 1 I[X,  ,>t.]^  + tiI[X,  >t.]  f°r  1=1>2*  (5.3.26) 

(.il)  1 (ll)  1 


? = [R/^i=izj=i^x(ij)_T1i)  + EI=1  Cni~Ri ) Ct i-^i 3 } 1 1 [R 


+ M^i  (X(ij)-V  + (nr^xtj-^)}]1 


i ’2 


[r1>i,r2=o] 


Ro>1] 


+ + (n2-R2)(t2'V^I[Rl=o,R2>1]  (5-3-27) 

In  this  case,  the  modified  MLE's  of  p^'s  are  given  by 


"i  - X(il)  - - I[X(ii)>tt]]  0-1,2) 


Then,  the  following  results  are  true  under  (5.3.11)  as  n -*•  ®. 

(i)  — *■  X U where  U is  exponential  with  failure  rate  £ 

Proof.  For  0 < z < 

A 

P(n(p1-p1)  > z)  = P[X(11)  > z/n  + qj 

= ^ z/n  +r,  nl5  exP [-n2 S(x-h) ]dx  + exp[-n1?(t1-p1)] 
nl 

= exp[-  — cz] 

a 

pCn(ri2-Tl2  ))  = nCtj-r^)  = exp  [-n?(  1 j-rij ) ] 

Taking  limits  as  n + °°,  the  result  follows.  □ 
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di) E[n1(n1~Ti1)]2  > 2?  2, 

Efn^n^np]  •>  ? as  n1  ->■  » 

Proof  Straighforward  calculations. 

a 

(iii)  n2(n2-n2)  U as  n2  ->■  oo. 

Proof  Along  the  same  lines  as  (i). 

(iv)  E(n2(n2-n2)  )2  2?  2 

E(n2(Ti2-n2))  -*■  5 as  n2  + ®, 

Proof  Straightforward  calculations. 

a 

(v)  n^T^-n.)  — ► (u-£  ) as  n1  ■>  oo. 

Proof  Using  the  fact  that  1-1  , = I r . . -,  one 

LXC ll)  * ciJ  lT1<x(ii)<ti J 

gets 


“i^i  V ni(x(ii)  V (ni  0 ll[Vx(11)<t1]- 

!n  view  of  (i)  and  (5.3.28),  it  suffices  to  show  that 


(5.3.28) 


~-l  P -1 
C -►  ? • 


It  is  easy  to  check  that 


a.s. 

-»•  n. 


i = 1,2. 


Also,  Ti 


n. 

l 


£A[(Xirni)ltx  -nftl-ni]+  (tr\)I[x  ] -n.(nrn) 

~~  -V.  — ■-  111 


n . 


a.s*  “1  , , P 

+ ? p.  as  n « and  i^/n^  (for  i=l,2)  by  the  WLLN 

where  pt  = 1 - expf-dt,.-^) ] . 
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Note  also,  that  1,^^  1 


while  I 


a.s. 


[r1=o,r2>i] 


0 and  I 


3.  • S • 


[R^l,  R2=0] 


* 0. 


Hence,  using  (5.3.27) 


LVn  n n n n n n n J [R  >1,  R >1  ] 


n R n„  R n,  T,  n„  T 


1 


1 


n R n T 

+ (-1  -l)  r , (_£_£/_£  I 

''n  n n n ; [R  >1.  R =0]  ^n  n 'n  n J [R  =0,  R >0]J 


n2  R2,n2  T2- 


-1 


-~-+  [(^P1+(1~^)P2/X?  1 Pj  +( 1-A) ^ ip2)]‘ 

□ 

a 

A 0 0 A 

(vi)  E[n(n1-n1 ) ]2  ->■  X £ and  E[n(n^-n^)] 
Proof:  For  0 < 5 < 1 


-1  ^ i-l 


=[l/C  ] ^ = ? as  n + «. 


+ 0 as  n + °°. 


r,  '\l2+l5  ol+|5r  2+6^v  h2+5 

L n L n i n i } J < 2 [n  [X,  -n  ) 


+ r£_)2+6  *-(2+6) 

S 


I[ni  < xoi)  < v1 


Note  that 

2+6,„  x2+6 


sup  E(n  (X^.v-D.)  ) < sup / (n(u-n  ))  + n £exp[-n  c(u-p )]du 

n>l  n>l  nl  1 1 11 


while 

;-(2+6). 


E(?" 


= sup(^-)2+6/“  z2+6?exp[-cz]dz  = 0(1) 
n>l  1 nl 


T +T 

1 2i2+6n 


c p i— _]  j 

[nl<X(ll)<tl]  R [R1>1,  R2>1] 
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+ E^R1I[R1>1] 


]2+6  + E[/l,  12+6 


•R2  [R2>1] 


ni(t  -n  ) + n (t  -n  ) n 

< [-^-l  ^ 2 2 ]2+«  Et^^I  + 0(1) 


n 


= 0(1) 

where  we  have  used  arguments  similar  to  (5.2.16)  - (5.2.20). 
Hence  (n^  (ri^-n^))2  is  u.i  and  using  (v)  the  result  follows.  □ 

(vii)  n2(n2-n2)  -+  (u-e-1). 

Proof  The  proof  follows  along  the  lines  given  in  (v) . 

o r\ 

(viii)  E(n2 (p2— n2 ) ) 2 > £ and  E(n2(n2~n2))  + 0 as  n^  °°. 

Proof  The  proof  follows  along  the  lines  given  in  (vi). 


(ix)  (c-1-?  l)  ->  N(0,c  2(Xp11+  (l-X)p21)(Xp1  + (1-X)p2) 

Proof 


/n  (r1  - r1)  = 


- Tl+T9 

/n  [~v2  I 


r2+r2  [r1>i,  r2>i] 


- ?] 


“ T1  - T2 
“ I[R1>1,  R2=0]  + /n  R^  I[R1=0,  R2>1] 


n /2‘  R ^i=lj  = l^Xij  T1i^I[xi.<t.]+(t:i"T1i)I[xi.>ti] 


? I[Xij“ni<ti'ni]^I[Rl>1»  R2>1] 


R ^nl(nrT1l))I[Ri>i>  R2>1]  R (n2(T12  n2)^I[R1>l,  R2>1] 
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- T1  - T2 
+ /n  I[R1>1,  R2=°]  + /n  i[r1-0,  r2>i] 


+ ^ C*'I[R1>1,  R2>1]  ^ 


(5.3.29) 


Since  n^n^rij)  — ► exponential  with  failure  rate  5 and 

^ ^ g 

+ (1-X)p2  it  follows  that  the  second  and  third  term 

in  (5.3.29)  tend  to  zero  a.s. 

T1 

Also  P[/J—  I[Ri>Ij  R2.0]  * 0]  < p[r2-0]  - e*p[-n25<t2-n2>] 


1 

Hence,  using  the  Borel-Cantelli  lemma  /n  — I 


3.  • S • 


Rj  [R1>1,  R2=0] 


->■  0 


Similarly,  ^^I[Ri,0>  R2>01 


a.s. 


and  /n  5(1 


1 ^ 3.  • s • 

[R.>1,  R0>l]"ij 


0. 


1 * “2’ 

Then  the  limiting  behavior  for  /n  (5  -5  ) is  the  same  as 

the  limiting  behavior  of 


-V- 


2 n. 


2 till  j*l  ttxirni)lt , ♦ (t^)! 


1J  J 


ij  i' 


? I[Xij"T1i<ti"I1i]^R  I[Ri>1»  R2>1] 


= n"  X/2  f i1  y + z2  Y 1-  I 

Lj  = l lj  j-1  Y2j  R 1 [R1>1,  R2>1] 


where 
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? :[x. ,-n.  < t.-n.] 

ij  i 11 


-2 

are  iid  with  mean  zero  and  variance  p.£  (i=l,2). 

Hence,  using  the  central  limit  theorem  as  in  Chapter  Three, 
and  the  fact  that  I, 


[R  >1,  R >1] 
,-l  Z 


cL  • S • _ . 

+ 1 and 


n/R  + (Ap^+C 1-X)p2)  . (In  fact  it  can  be  shown  using  the  Borel- 


Cantelli  lemma  that  n/R  (Xp^+( 1-X)p2)  i). 


\— 1 , 


»(o.T^7-?w)P2)  )• 


Note  that  using  Lemma  3.2.2  one  gets  that 


^ K Nf°'  >Pl  + n-»p2)  D 

(x)  E(n( )2]  - c‘2(XPl  + a-X)p2)_1 

Proof  It  suffices  to  show  that 

sup  E[/n  | C ~C  | ] < “ for  some  0 < 6 < 1 (5.3.30) 

n>  1 

To  proof  (5.3.30),  note  that 


eHc'V1|)2+2<  < 31+2S[e[^(^i[Ri>1j  v1]-c)]: 
+E^^1V1,  r2-o,]2+25+^^1Vo,  r2>11]2+2S- 


Tl+T2 


l 2+26 


Since  T^  < n^(t^-p^)  for  i=l,2,  then  using  (5.3.11)  one  gets 


that 
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E[/n  Ri  I[Vl-  E2:“|i  6 ‘ e(riI[ei>1i^  (tr"i)I[R  -oi] 


2+25 


but  ECn/RjIj  )2+2fi  = 0(1) 


(5.3.32) 


and  E(y^  (tl  t1i)i[r2=o]^)2+2<s  ' (~(trTii)2+26exp[-n2?(t2-Ti2)^  0 


as  min(n^  .n^)  + °°. 


(5.3.33) 


Similarly  . H]l2+26 


1Z+ZO  . 

J < °°. 

2 l“l  "2r'  ' 

Hence  it  remains  to  show  that  the  first  term  on  the  right 


hand  side  of  (5.3.31)  is  bounded.  To  this  effect  note  that 


T +T 

E[^  I 


Rj+R^  [Rj>1,  R2>1] 


_^-l ^ 2+2  6 


E[R1+R2I[R1>1,  R2>l]^n  Ylj+  jI?Y2j)  + n"V2(ni^rbi)) 


-1/, 


n '2  (n2(n2~T12)))  + /n  C 1(Ii  ^m2+26 


'[Rj>1,  R2>1] 


-1)]' 


(5.3.34) 


Using  the  c^-inequality,  one  gets  that  (5.3.34)  is  less  than 


n 


/ 1+2  <SrT?r_n_'\  2+25  T r t ~ Vo  t U1  ; L 

E R’  +R-^  ItR1>l,R2>l]  2 (j  = lYlj  + j=lY2j^ 


2„  ^2+25 


1 2 


+ (n  /2  (n1(n1-ri1)))2+26  + (n  ^ (n^-r^)  ))2+2<S] 


* kC/s-c-^i,  ,-or*]. 


(5.3.35) 
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We  already  know  that 
* _ 

E(ni(ni~ni))  = 0(1)  for  s > 0 i=l,2 


(5.3.36) 


and 


Vi/+4i<  e(^7  • 17 1[R1>u^4+45  ■ 0<1)  <5-3-37) 


Also 


E(-' 1/2  (jllh:  + jit  ‘ [*(|  ijY 


n2  „ >>4+46  „ -( 2+26) 03+46 | “l„  | >4+46 


♦ E(|E.!1Y2.|)W5]<  n"(2+26)23+46(K^n2+26+  ^2+26, 

where  in  (5.3.38)  we  have  made  use  of  Lemma  3.2.1  in  Chapter 
Three.  In  addition, 

«(/=c-»Ci£Ri>1.  R2>11-i})2+26  < * 0 


as  min  n.  •+• 
i-1,2  1 


(5.3.39) 

Hence,  using  (5.3.36)  - (5.3.39)  and  the  Cauchy-Schwarz 
inequality  in  (5.3.35),  the  result  follows.  □ 

Remark  3 The  sufficient  statistic  in  this  case,  is  given  by 

~2  = ^X(ll)’  X(21 ) ’ Rl+R2*  j = lXlj  + j = lX2j^ 

Again,  its  density  is  untractable  and  may  not  be  complete. 

As  in  the  previous  case,  one  can  obtain  a result  analogous  to 
Theorem  2.3.12  by  working  with  all  ordered  failure  times,  and 
R2*  Hence,  one  can  show  that  a function  h(Ti^  .t^,  C)  is  estimable 
only  if  it  is  of  the  form  rjQur(  , n2  )?r  where  u^r^,^)  does  not 
depend  on  and  n2«  So  neither  r^,  n2  or  s-1  admit  an  unbiased 
estimator.  In  fact  even  if  at  least  one  is  known,  there  still 
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does  not  exist  an  unbiased  estimator  for  £ ^ which  is  the  same 
result  obtained  for  the  with  replacement  case. 

If  ? is  known,  then  X^j))  is  complete  sufficient  for 

(h1,n2)*  I*1  this  case  the  UMVUE  of  p^  is  given  by 

h(xui))  ■ xuir  5~\h-itx  >t ,) for  1-1>2- 

(il)  iJ 

Finally,  we  consider  the  case  when  p^  = p2  = P and  = £2  = 
£•  Write  Z = min  (x^^,  X^^),  R = R^+R2«  In  this  case  the 
MLEs  of  p and  £ are  given  respectively  by 


p = Z(l-I 


[z>tj)  + tiI[z>t1]; 


(5.3.40) 


1- 

R„ 


5 ' + Ei-i<ni‘Ei,<trn,HI[Ri>I>R2>l] 


* hl/(Eji,(x(ljrS)  ♦ (n1-R1)(t1-S)}]llEi)l!V0] 


R9  * 

+ [R2/{lj  = 1(X(2:j)-p)  + (n2-R2)(t2-p)}]l 
The  modified  MLE  of  p is  given  by 


[r1=o,r2>i] 


" ‘ " ' (n'rl(1-I|z>til) 

Then  if  we  assume  (5.3.11),  the  following  results  hold 


(5.3.41) 


(5.3.42) 


true  as  n 

(i)  n(p-p)  > U, 

where  U is  exponential  with  failure  rate 

(ii)  E[n(p-p)]2  -»■  lx,  2,  E(n(p-p))  -►  ? 1 , 

(iii)  n(p-p)  -*■  U - X,  1 , 

^ A 

(iv)  • E[n(p-p)]2  -*■  X,  2;  E(n(p-p))  -*■  0, 
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(v)  /n(c  1 - c"1)  N(0,c  2(Xp1+(l-X)p2)~1) 

where  1-Pi  = exp(-c(t  -n))  i-1,2; 

(vi)  E[n(c_1  - c”1)2]  * C_2(XPl  + (1-X)p2)“1. 

All  proofs  are  omitted  because  of  the  similarity  to  those  given 
already. 

Remark4  As  in  all  previous  cases,  the  derivation  of  the  density 

R1  r9 

of  the  sufficient  statistics  T_  = (z,  R +R„,  + .Z7X,n 

~3  12’  j=l  (lj)  j = l (2j)J 

becomes  quite  formidable  and  the  induced  family  of  densities  may 
not  be  complete.  Again,  by  working  with  the  joint  density  of  the 
ordered  failure  times  for  both  groups,  R1  and  R2,  one  can  obtain  a 
result  analogous  to  the  one  obtained  for  the  with  replacement 
case,  namely  that  if  a function  h(ri,£)  is  estimable  then  it  is 
necessarily  of  the  form  r|0ur(ri)cr  where  uQ ( n ) does  not  depend  on 
q.  Hence,  neither  q nor  £_1  is  estimable.  Also,  when  n is  known 
C 1 is  still  not  estimable  and  when  ? is  known  n has  UMVUE  given 
by  h(Z)  = Z - ((n1+n2)c)"1(l-I[z>^]). 


CHAPTER  SIX 


GENERALIZED  LIKELIHOOD  RATIO 
TESTS  FOR  THE  WITHOUT  REPLACEMENT  CASE 
6. 1 Introduction 

In  this  chapter  we  consider  the  testing  problems  (i)  - (vii) 
(see  4.1)  when  sampling  is  done  without  replacement.  To  be 
specific,  suppose  the  experiment  consists  of  putting  n^,  ^.....n^ 
items  to  test  independently  as  explained  in  Section  1.1.  Then  the 
likelihood  function  of  all  observations  is  given  by  (1.1.10) 
namely, 


L^’  5)  = ieS exp [-ci  { jli  (x( ij  ) -ni )+(ni-ri 5 ( c i- ni > } 1 


X I 


ln,<x.  ,<...<x.  ' [“PC-'jtjCt  -«  ))]] 

1 (il)  (ir^^)  1 jeS  j j j j 


The  testing  problem  (i),  (ii)  and  (iii)  are  considered  in 
Section  6.2.  The  generalized  likelihood  ratio  test  (GLRT) 
criterion 

X is  computed,  and  the  asymptotic  distribution  of  -21ogX  is  given 
for  both  the  null  and  local  alternatives.  In  Section  6.3,  the 
testing  problems  (iv),  (v)  and  (vi)  are  considered.  In  this 
Section  the  GLRT  criterion  X is  computed,  and  its  null 
distribution  is  derived.  The  testing  problem  (vii)  is  considered 
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in  Section  6.4.  Explicit  computation  of  even  the  asymptotic  null 
distribution  of  -21ogX  becomes  quite  formidable  in  this  case,  but 


some  conservative  test  procedure  is  recommended. 

6.2  Testing  The  Equality  of  Failure  Rates 

We  shall  not  make  a notational  distinction  between  the  rvA  or 
its  value.  Before  carrying  out  the  actual  tests  the  same 
preliminary  facts  given  in  Chapter  4 are  needed.  Hence,  recall 
that  the  likelihood  ratio  is  defined  on  2k  distinct  regions 
according  to  all  possible  (k-tuple)  combinations 

of  £ = depending  on  whether  r^  is  greater  than  or 

equal  to  zero.  Let 

Aj  = {£:d  of  the  equal  zero},  j=0,l,...,k.  (6.2.1) 

Hence,  for  each  j,  A.  contains  fk'l  elements.  Write 


{)) 


lj  Bj£>  where  (B^,...,B  ^ } constitutes  a partition  of  Aj 

j (j  ) 


Aj 

by  elements.  Then 


ft 


Note  that  for  j > 1 , 


(6.2.2) 


p[<-a«*>i  , * o] 


< P(at  least  one  R.=0) 

l 

< Sk=1P(R.=0)  = 

0 as  min 

n . + oo. 
l 

(6.2.3) 

l<i<k 

Also,  P(R  e BQ  ) -*■  1 as 

min  n.  -*-<». 

, i 

Hence , 

l<i<k 
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-21ogX  = (-21ogA)I[ReB  j + op(l),  (6.2.4) 

where  by  op(l),  we  mean  a random  variable  which  converges  in 

probability  to  zero  as  min(n^  , . . . ,nR)  ■> 

First  we  consider  testing  HQ1.  From  (1.1.10)  it  follows  that 

for  R e B , MLE  of  is 

1 

h * Ei/fEjiix(ij)  + (ni-Vci-Vi} 

■ V(IA(xij-’’i)I[x..<t.] + (ti-"i)r"iiI[x..>t  ])  <6-2-5> 

ij  i ij  i 

i=l,...,k.  Also,  under  ,for  R e B , MLE  of  the  common  failure 


rate  £ is 


? R/^i=lEj  = 1(Xij_T1i)I[X  <t  ]+Ei=1(ti  T1i)Ej=1I[X.  .>t.  ] 

!J  1 IJ  1 


where  R = 2.  , R 
i = l l 


(6.2.6) 


• fC 

i=l , . . . ,k,  and  T = T_^ . Then,  one  can  write 

* A 

?i  = (i=l,...,k)  and  t,  = R/T,  (6.2.7) 

a 

when  R e B^  . Substituting  these  estimators  t,,  ’s 

a 

and  x,  for  C^'s  and  c.  in  the  likelihood  function  given  in  (1.1.10), 
f°r  R E > the  GLRT  criterion  X is  given  by 


(6.2.8) 
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Using  the  strong  law  of  large  numbers  ( SLLN) , as  n±  ®, 


E[[xir,'ih[x  <t  i * Whx..*.]  ] ■ v!1-  * 

ll  i il  iJ 

the  above,  we  have  used  the  fact  that  X^-t^’s  are  iid  exponential 

with  failure  rate  and  1-p^  = exp(-£^(t^-r)^)  ) . Next  observe 
that 

-1/  _ 1/  n. 

n 2 (R  -?  T ) = n '2  Z.1  Z.  . , 

i i l i i j=l  lj’ 


(6.2.9) 


where 
Z.  . = 


ij  Itxij<ti^  T1;L^Ifxij<ti]  Ci(ti  T1i)I[X.j>ti]’  (6*2,10) 

for  i=l,2,...k. 

Note  that  are  iid  with  E(Zn)  = 0 and  V(Zn)  = Pi. 

Hence,  using  the  central  limit  theorem,  as  n,  + 

’ l * 


ni  1/2(Ri-CiTi)  N(0,p.), 


(6.2.11) 


Since  l^/n.^  -►  pi^i  as  ni  * °°>  ^ follows  form  (6.2.11)  that 

TI1/2(Ri-?iV  ^ (6.2.12) 

In  order  to  find  the  limiting  distiribution  of  -21ogX,  we 
make  the  following  assumption 

lim  n^/n  = X , 0<X  <1  and  X = 1 where  n = IR_  n . . (6.2.13) 

n-H»  i i j.  l l— I i 

We  now  prove  the  first  theorem  of  this  section  which  provides 

the  asymptotic  null  distribution  of  (-21ogX)Ir  ..  Since 

[£  £ B01 

= exP  (-n^  (t^  + 0 as  min  n.-*-  °° 

l<i<k  1 

which  holds  under  (6.2.13)),  it  follows  that  under  (6.2.13), 
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-21ogA  has  the  same  limiting  distribution  as  (-21ogA)I,  , 

l£eBor 

Theorem  6.2.1  If  (6.2.13)  holds , then  as  n + » , 
under  HQ1 : q = ...=Ck  = C,  -21ogA  --»■ 

Proof  Since,  = ...  = ?k  = ?,  using  Taylor  expansion 
for  R e B^,  one  gets  from  (6.2.8), 

-21ogA  = 2[z^=1R.log(Ri/Ti)  - R log(R/T)] 

= 2[z^=1R.log(Ri/(CT1))  - Rlog(R/(CT))] 

= 2[Ej=1(R.-?Ti+cTi)log(l+(Ri-?T.)(cTi)"1) 
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-Rlog(l+(R-CT)?T)  ) 


= 2[Ej=1(Ri-?T.+CT.){- 


R 


.-CT.  (R.-?T.); 


?T 


2(?T.)- 


6(?T.)3(  !+<(,. 


R.-CT. 

_J: L)3 

?T.  J 


-(r-ct+st) 


fR-CT)2 

2(?T]2 


+ 


fR-ST)3 

6(?T)3(1+^SI)3 


}]  (6.2.14) 


where  0 < 4>i  < 1 (i=l,...,k)  and  0 < $ < 1. 
(6.2.13)  and  the  fact  that  T^/n^  p^£  ^ 

from  (6.2.14)  after  some  simplification  that 

(-21osX)I[Reb01] 


Using  (6.2.12), 
as  n.  -»•  it  follows 

l 


= {Zi=i(Ri-5Ti)2(?Ti)"1  - (R-?T)2(^T)"1}I[R£boi]+  °p(D  (6-2.15) 
Hence,  for  proving  the  theorem,  it  suffices  to  show  that 
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Q = ^-l(Ri-«Ti)2(5Ti)"1  - (R-CT)2(5T)  1}l[ReB  j 
L , 

“*■  *£-1  under  H01*  (6.2.16) 

To  prove  (6.2.16),  write  Q = f Y'AY) I r 

~ [ReB01] 

where  Y = with  Y.  = (R . -?T. ) (CT.)~  V2  (i=l,...,k), 

and  A - Ik  " uu',  u = ((Tj/T)  ^ ,...,(Tk/T)  ^ . 

Since  T_^/n^  ■+  p^£  as  n -*•  <=  and  (6.2.13),  holds  , it  follows 

that  A ----+  Ifc  - dd%  where  d'  = (dA , . . . ,dfc)  with 


di  “ ^PiAi^i=lpiXi^  ^ and  Pj;  = l-exp[-c(ti-ni)] . 

Next  observe  that  I - dd'  is  symmetric,  idempotent  with 
rank  (I  -dd")  = trfl  -dd'l  = k-1. 

Moreover  Y ^ Nk(0,Ik)  as  n -»•  ».  Hence,  using  Lemma  4.2.1  and 

Slutsky's  Theorem,  y'AY  ^ X,2  , under  H„,  . 

~ ~~  k-1  01 


Since  I 


[££B01i 


1 as  n -►  ®,  one  gets  (6.2.16).  □ 


Next  consider  the  sequence  of  local  alternative 

- Vo 

^i  - ? + ^ini  2 (i=l ,2, . . .k).  Use  the  same  Taylor  expansion  for 


-21ogA  as  in  (6.2.14).  Now  write 

Yi  = (Ri-?Ti)(?Tir1/2=  (Ri-CiTi)(cTir1/2+(ci-C)T.(?Ti) 


= U±/0  1/2(Ri-?.T.)(?iTi)  1/2+A.(T./ni)  ^ ? \ 


Note  that  in  view  of  (6.2.13),  + 1 as  n -»•  ». 


Pi? 


-1 


as  n ■+■  ®,  since  5. 


-1 


-1 

£ as  n + ®. 


Also,  T_^/n^ 


a.  s . 
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Here  - 1 - exp[-£(t^-p_^)  ] . Hence,  using  independence  of  the 

Vs’  l Nk(^’Ik)»  where  = (fi1,..-6k),  6i  = 


As  before  A Ifc  - ddT  where  d = (d  ,...,dk)  with 


di  = {^iPi^i=l^iPil  ^ * Hence>  using 


Lemma 


4.2.1  y'AY  L. 

»here  tj  - 5'(lfc  - dd ')«  - S*  - (l^fjdj)!. 

Next  we  consider  testing  HQ2.  In  this  case,  the  MLE  of  p is 

r\  = min  X and  the  MLE  of  r.  is 

l<i<k 

- R • 

?!  - vlWd-j)  + (vWv) 


= Ri/{Ti-n± (n-n) } = R1/Ti  (say)  (6.2.17) 

Under  HQ2,  ^ = • ••  = 5 = and  the  MLE  of  ? is 

? = R/{T-n(p-p)}  = R/T*(say)  (6.2.18) 

In  this  case,  for  R e B , the  GLRT  criterion  A,  reduces  to 
k r ~ 

X = i2x  (VRi)  1 (r/t*)R  (6.2.19) 

Next,  observe  that  if  (6.2.13)  holds, 

T*  / a.s.  — 1 . A a.  s . 

Pi?i  as  n ■*•  »,  since  p -►  p as  n 

Moreover,  if  (6.2.13)  holds,  since  n(p-n)  = 0 (1),  n~  V2 

p)  — *■  0.  Accordingly,  under  Hno,  Z.  = (tT*)~  ^ (R  -CT*) 

02  1 1 i iy 
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Moreover,  if  (6.2.13)  holds,  since  n(p-p)  = 0 (1),  n-1/2(^- 

n)  -->■  0.  Accordingly,  under  H „,  Z.  = ( CT*) " ^ (R  -rT*) 

U2  l i i i 

= (cT*)_1/2  [(R1-?Ti)  + ?(T  -T*)] 

= (ni/?T*)1/2n;1/2[(R.-CTi)  + n.?(p-p)] 

N(°»D  (6.2.20) 

Note  that  the  Z^s  are  not  independent  since  they  all  share 

a 

the  same  p. 

Following  a Taylor  expansion  similar  to  (6.2.14),  one  gets  as 
in  (6.2.15) 


(-21ogX)I  = Q I + o (1) 

L~  0lJ  ° [SieBoi]  P 

Where  Q0  = with  z:  = (Zl,...,Zk),  Ao  = Ik  - PoJT, 

= ((T*/T*)  1/2  ,-‘-,(T*/T*)  ly2  ).  Also 


(6.2.21) 


3 • S • 

A ----->■  I - dh"  as  n + » when  (6.2.13)  holds.  Write 


~o 


wi  ■ (nl/«Ti)1/2"i1/2(Ri"?Ti)'  1’1-2 k. 


»ha«  T.  - [<Xir,)It  tJ  + (ti-ri)I[x^  >t  j ] 


and  p is  unknown. 


ij  i 


ij  i 


Note  — ► N(0 , 1 ) and  the  W.^ ' s are  independently  distributed. 

Also  Z^  - — ► 0 (i=l,2,...k)  as  min  n.  -*■  ». 

l— l,...,k 

Using  the  Cramer-Wold  device,  Slutsky's  theorem,  Lemma  4.2.1 
and  the  fact  that  P(ReBq^)  1 as  n +•  °°,  one  gets 
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- C + ^ since  from  the  first  line  of  (6.2.20) 


zi  = (?V  1/2[(Ri-?TJ)  + Cc±-C)T*j 


= (?i/?)  1/2  (?.T*)  l/2  (R.-C.T*)  + A.(T*/n.)  ^ 5 ^2 


L * 

-+  N(6.,l) 


where  6^  - A^p^  ^ ^ and  = l-eXp  [-£( t_^-p)  ] and  p 

Since  the  Z^'s  are  not  independent,  we  write 


V,  - V- 


w.  = (n./sT.j^n  ^(r.-^t.)  + A.  (T . /n.  ) ^2  ? l/2 


*i,  V- 


,-V- 


" "2  ^i^"  72  K'Vi)  + V2  5"  V2 

and  observe  that  W.  -+  N(6*,l)  and  W.-Z.  --*■  0.  Since, 

11  11  ’ 

L * 

are  independent,  W --»•  N(6  ,1.  ) where  M'  = (W,  ,...,W,  ) 
~ ~ k ~ l k 

*iip  ^ ^ 

and  6 = (6.  , . . . , 6,  ) . 

~ 1 k 

Arguing  as  before  for  the  given  sequence  of  local 
alternatives , 

-21ogX  K X2_i(x2)  where  t2  = lJ=1(S*)2  ~ (^=1V*)2 


* r * k *,  l/„ 

Hare  - fX^/E^l^}  <2  . 

Finally,  in  this  section,  we  consider  testing  Hq2* 

case,  the  MLE  of  p^  is  p^  = anc*  f°r  £e®01  ’ ^i  ^as 

A 

= Ri/Ti0>  where 


n . 


Ti0  Ej  = l Xij  1 [X.  <t  ] + tiEj=lI[X.  ,>t.  ] nini 


ij  i' 


ij  i 


(6.2.22) 

is  unknown. 


the  ' s 


In  this 
MLE 


-148- 


-ni(ni-Tii)  (6.2.23) 

Under  HQ3 , the  MLE  of  5 is  £ = R/TQ  where  TQ  = S?=1Ti(). 
Essentially,  repetition  of  the  previous  steps  now  give  that  under 
H03’  ~21°g*  x^_1 » and  under  the  sequence  of  local  alternatives 

- Vo  L 

“ 4 + A^n^  (i=l , . . . ,k)  , -21ogX  — ► where 

T3  = ^Zi=l6i  ) 2 " (Zi=i6i  di  )2>  with 
**  **  1 L -1  ** 

= AiPj[  ^4  ’ Pi  = ■z— exP  L — c — ^ ] (here  the  q^’s  are  all 


, . **  , **  k **  1/ 

unknown)  and  d.  = (X.p.  /E  X p ) 2 

1 v i*i  i=l  iFi  ' 

6 • 3 Testing  The  Equality  of  Locations 

First  consider  testing  Hn/i.  Note  that  R e B„,  <=>  X,  , < t 

~ 01  (il)  i 

for  all  i = l,...,k.  Accordingly  for  R e B^,  the  MLE  of  is  ^ 
= ^(il)>  and  under  hq4*  tde  °f  tde  coinn!on  location  parameter  q 

A 

is  q = min  X,. ...  As  in  Chapter  Four,  the  GLRT  criterion  X is 
l<i<k  ^ ' 

given  by 

X = exp[-E^=1  n.(qi-q)],  (6.3.1) 

when  J-IeBqi.  Since  the  ’s  have  the  same  distribution  as  in 

the  with  replacement  case,  using  the  same  argument  as  given  in 
Theorem  4.3.2  of  Chapter  Four,  one  gets 
-21ogX  h x2_x  under  HQ4 
provided  (6.2.13)  holds. 


as  n <=° 


(6.3.2) 
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Next  we  consider  testing  HQ5.  Let  ReBQ1 . In  this  case,  the 

A 

MLE  of  ni  is  Hi  = X(ilj,  and  from  Section  6.2,  the  MLE  of  the 

A 

common  scale  parameter  ? is  £ = R/TQ.  Under  HQ5,  the  MLE  of  the 

common  location  parameters  n is  n = min  X while  the  MLE  of 

„ * 1 <i<k 

C is  c = R/T  . Accordingly  for  ReBQ1 , the  GLRT  criterion  X is 

given  by 

A 

-A  'NR 


* = (s/0R  - (Tn/T*)R 


(6.3.3) 


Hence, 


* 

T -T 


-21ogX  = -2Rlog(l (6.3.4) 

T 

From  the  previous  section, 

T*-To  = {T-n(n-n)}  - {t  - ER=1njL(S.-n)} 
k A 

= Si=in1(rii-Tl)  >0 

with  probability  1 so  that  0 < (T*-Tq)/T*  < 1 with  probability 
1.  Now  using  the  inequality 


- x - 


2( 1-x) 


< log  (1-x)  < -x  for  0 < x < 1, 


it  follows  from  (6.3.4^  that  with  probability  1, 
* -Tq)2 

2R(T  -TQ)/T  - 


> -21ogX 

> 2R(T*-Tq)/T* 


* 

T T 


0 


(6.3.5) 


We  have  seen  already  that  under  H^:  Tjj  - ...  = \ = b,  2?(T*-TQ) 

2?  2i=l  ni^rli-Ti)  -*■  X2(k_i)* 

Also,  R/(?T  ) -----*■  1.  Moreover,  since  T*-Tq  = 0p(l), 

R/T*  5 and 


^ • S ^ ^ p 

T0 ^ + » as  n <*>,  R(T  -TQ)2/(T  TQ)  --*•  0 as  n ». 

Hence,  it  follows  from  (6.3.5)  that  -21ogX  --*■  X2  lN  under  Hnt-. 

2(k-l)  05 
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Finally,  we  consider  testing  HQ6.  For  ReBQ1,  the  MLE  of  n± 

A 

is  n±  = x(i!) . while  the  MLE  of  q is  q = %/Ti0»  When  HQ6 
holds,  the  MLE  of  the  common  location  parameter  q is  q 


min  X and,  the  MLE  of  q is  q = R /T*  Then  the  GLRT 
l<i<k  v ' 111 

criterion  A is 


R. 


\r  * * A -i 

x ■ A Ot/cJ  . 

Hence,  for  ^eBq^, 
-21ogA 

A 


(6.3.6) 


" -2Zi=lRil0S  0 ' 


* 

T . -T 
i lO 


)• 


(6.3.7) 


Since,  T^q  - q(q-n)  > 0 with  probability  1,  using  an 


inequality  similar  to  (6.3.5),  it  follows  from  (6.3.7)  that 
_k  _ f * * . * 


2Ii-iEi«Ti-Tto)/Ti  - <TrTio)2/(LTio)J 


> -21ogA 


> 2Ii=1R.(Ti-Ti())/T*  . 


(6.3.8) 


When  H06  holds,  R±/(qT*)  ----+  1,  and 

2Zi=lCi(Ti'TiO)  = 2Zi=lVi(ni“n)  X2(k-1)  (6.3.9) 

The  proof  of  this  result  is  similar  to  the  proof  of  Theorem 

(4.3.2)  of  Chapter  Four.  Next  we  write 

2iiVvxioK = zi=i2((Ri/T*)-?i)(T*-Ti0) 
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(6.3.10) 


and  note  that  under  Hq^, 

^=r2((Ri/T*)-?i)ni(n-n)  < ^=12((VV“CiK(V^ 

<Zi=l2((Ri/T*)~?i)ni(rli-Tl).  (6.3.11) 

* L 

Recall  that  n^^^(ri^-n)  -- ► U,  where  U is  distributed  as  an  exponen- 
tial random  variable  with  mean  equal  to  one. 

k ~ L p 

Also  Zi=1ni?i(q-n)  — ► U and  (R^Th)-  5 + 0 as  min  n. 

l<i<k 

Hence  both  upper  and  lower  bounds  in  (6.3.11)  go  to  zero  a.s. 


which  implies  that 

E-_i2((R, /T  )-  5 )n  (q  -n)  + 0 as  min  n. 
1_1  11  111  l<i<k  1 


(6.3.12) 


Combining  (6.3.9)  - (6.3.12)  it  now  follows  that 

“wVVhoK  *2(k-l) 

Also,  as  min  n.  + 00 , 
l<i<k1 

2ItiRi(Ti-Tio)2/T‘Tio  1 0 


(6.3.13) 


(6.3.14) 


since 


(W2  = (ni(\-^)2  = 0p(D 


and  R1/Ti  > while  l/TiQ  0. 

Hence,  using  (6.3.8)  and  from  (6.3.13)  and  (6.3.14)  it  now  follows 
that  under  Hq^, 

-Ziogx  K X2(k.0. 

^•4  Testing  For  Location  and  Scale  Parameters 

In  this  section  we  test  Hgy . Note  that  for  ReBQ1,  the  MLE  of 
/\ 

Pi  is  n±  = X(il),  while  the  MLE  of  q is  q = Rj/T^.  Under  HQ7 
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f°r  ReBq^,  the  MLE  of  the  common  location  parameter  p is 

P = min  X,.- . , while  the  MLE  of  the  common  scale  parameter  is 
l<i<k 
l = R/T*. 

Accordingly,  for  £eB01,  the  GLRT  criterion  is  given  by 
k ~ ~ R,  k T R. 

* - 1 - (7  • -f ) 1 


Recall  that  T = T - n(p-n) 


= ^=itTi  - Vn_T1>)  = Ei=lTi  (sax} 


where 


Ti  Ei=l^X(ij)  ] + (ti  Tl)I[X(ij>t;.]  ^ 1 1’2,",,k 

and 


Ti0  - Ej=i ni)1 
for  i=l ,2, . . . ,k. 


(x..<tlJ  + (ti‘"i)I[x..>t1l)  - WV 


Hence  for  ReBq^, 


-21ogA  = 2(zJ=1RilogCi  ~ Rlog?) 


= 2[2^=1Rilog(?./?)  - R log  (5/5)] 

= 2tzi=iRi  log  ^RiTi/cT*Tio^  " R log  (R/T*0 
= 2[^=1Rilog(R./cT*)  - ^=1R.log(Ti0/T*)  -Rlog(R/T*C)] 

= 2 [ E±=1  CRi“^Ti  + CT.)log(l  + (R.-CT.K^T.)"1) 
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- (R  - ?T  + ?T)log(l  + (R  - ?T)(CT)-1)] 


* 

T - T 

- 21^^.108(1  - 1 „ 10)  (6.4.1) 

T . 

l 


Now,  combine  the  arguments  used  for  testing  HQ1  and  HQ2  as  well  as 
Hgg.  This  leads  to 


■21osXIlReB01)  ' * °p(l)  (6.4.2) 

as  n + °°,  where 

Q1  = Zi=l^Ri  ' ^Ti)2(?T*)_1  - (R-CT*)2(cT*)_1  (6.4.3) 

Q2  = 2Ei=lRi(Ti  ” TiO^/Ti  (6.4.4) 


Under  HQ7,  for  ReBQ1,  K x2k_0  and  ^ X2(k_1}.  Also 


t a.  s . 

^ReBoi]  * 1 


However  and  Q2  are  not  independent.  Thus,  under 

H07,  -21ogA  K Y1+Y2  where  Yj  ~ X2^  and  Y2  ~ X2(k  , but  Yj 
Y2  are  not  necessarily  independent . Hence , as  explained  in  Hq7 
the  with  replacement  case,  if  we  reject  when 

-21ogX  > VK2  where  ^ - xJ.1;a/2  end  . a/2 

and  Xn;a  denotes  the  upper  100a%  of  X^,  then  it  follows  that 


and 

for 


asymptotically  the  proposed  test  procedure  has  size  less  than  or 
equal  to  a. 


CHAPTER  SEVEN 


FUTURE  RESEARCH 


In  this  investigation  we  have  considered  inference  regarding 
the  parameters  of  one  or  more  location  and  scale  parameter  expo- 
nentials under  Type  I censoring  for  both  the  cases  when  sampling 
is  done  with  replacement  and  without  replacement. 

Future  research  related  to  the  above  area  can  proceed  along 
several  lines.  First,  we  have  only  considered  singly  Type  I 
censored  data.  More  general  censoring  mechanisms  such  as  multiple 
Type  I censoring  with  random  or  non-random  censoring  times  as  well 
as  hybrid  censoring,  which  is  a combination  of  Types  I and  II 
censoring,  are  of  interest  from  a theoretical  as  well  as  practical 
point  of  view. 

Secondly,  we  have  restricted  ourselves  to  the  two  parameter 
exponential  family.  Other  parametric  families  could  be  studied 
under  the  same  setting  as  covered  by  the  present  investigation  or 
under  more  general  setting  as  described  in  the  previous  paragraph. 

In  particular,  the  Weibull  family  of  densities  which  occupies 
an  important  position  in  life  data  analysis  would  be  an  interest- 
ing candidate. 

Moreover,  one  can  study  the  properties  of  estimators  and  test 
procedures  obtained  under  other  modes  of  sampling  such  as 
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sequential  sampling  of  censored  data.  It  is  also  of  importance  to 
note  that  the  methods  presented  in  this  manuscript  for  hypothesis 
testing  in  a multisample  setting  as  well  as  the  properties  of  the 
MLEs  or  the  modified  MLEs  in  all  the  cases  are  more  applicable  in 
large  sample  situations.  The  adequacy  of  such  methods  in  small 
samples  remains  to  be  assessed  and  methods  for  small  samples  need 
to  be  investigated. 
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